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13  abstract 


U SPONSORING  MILITARY  activity 


Theory  and  methods  are  presented  for  analyzing  sensitivity  of  the  optimal 
value  and  optimal  solution  set  to  perturbations  in  problem  data  in  nonlinear 
bounded  optimization  problems  with  discrete  variables.  Enphasis  is  given  to 
studying  behavior  of  the  optimal  value  function.  Theory  is  developed  primarily 
for  mixed  integer  programming  (MIP)  problems,  where  the  domain  is  a subset  of  a 
Euclidean  vector  space. 

Compared  with  continuous-variable  mathematical  programs,  MIP  problems  demand 
mac>i  greater  corcem  for  data  sensitivity  and  for  model  formulation.  Continuous- 
variable  LP  (linecu:  programming)  problems  do  in  fact  produce  sensible  results 
in  n.ost  applications  because  of  the  inherent  continuity  properties  of  the  linear 
progra':'.  Unfortunately,  the  continuity  properties  that  characterize  LP  models 
do  not  persist  when  integer  restrictions  are  imposed.  Evidently,  great  care 
must  be  given  to  an  MIP  formulation  in  order  to  achieve  cm  acceptcible  formula- 
tion of  r.  real  worid  problem;  sensitivity  analysis  is  much  needed  as  a means  for 
determining  problem  behavior. 

Conditions  are  developed  that  assure  continuity  at  a point.  Point-to-set 
mapping  theory  plays  a central  role:  with  reasonably  weak  assumptions  on  the 

objective  function,  a discontinuity  in  optimal  value  is  possible  only  when  the 
feasible  region  is  discontinuous  as  a point-to-set  map.  When  this  map  is  "closed" 
tho  optimal  value  is  a semicontinuous  function  of  the  data  so  that  a "small" 
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chwge  in  data  cannot  create  incomtensurate  inqprovement  in  optimal  value;  this 
property  always  holds  for  bounded  linear  MlP  problems.  Continuity  in  the  linear 
case  is  assured  by  a single  post-optimal  set-interiority  condition.  Formulation 
methods  are  prescribed  that  mitigate  the  bogey  of  discontinuity  in  some  problems. 

A general  approach  to  determining  sensitivity  is  described  based  on  the 
construction  of  l.'.near  bounds.  Several  methods  are  given  for  discovering  data 
perturbai  Ions  that  provide  substaintial  improvements  in  the  optimal  value . With 
respect  to  data  defining  the  feasible  domain,  this  essentially  amounts  to  locat- 
ing points  of  discontinuity.  Analysis  of  sensitivity  to  objective  function  data 
is  especially  straightfo'.'ward  since  in  virtually  2dl  practical  discrete  optimiza- 
tion problems  the  optimal  value  is  continuous  (and  concave  in  most  cases)  with 
respect  to  such  data. 
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ABSTRACT  OF  THE  DISSERTATION 
Sensitivity  Analysis  in  Discrete  C^timization 

by 

Michael  Adrian  Radke 
Doctor  of  Philosophy  in  Management 
University  of  California,  Los  Angeles,  1975 
Professor  Arthur  M.  Geoffrion,  Chairmem 


Theory  and  methods  are  presented  for  emalyzing  sensitivity  of  the 
optimal  value  and  optimal  solution  set  to  perturbations  in  problem  data 
in  nonlinear  bounded  optimization  problems  with  discrete  variables. 

Emphasj  is  given  to  studying  behavior  of  the  optimal  value  function. 
Theory  is  developed  primarily  for  mixed  integer  programning  (MIP)  prob- 
lems, where  the  domain  is  a subset  of  a Euclideam  vector  space. 

Compared  with  continuous-variable  mathcunatioal  programs,  MIP  prob- 
lems demand  much  greater  concern  for  data  sensitivity  and  for  model 
formulation.  Continuous-variable  LP  (linear  progi amning)  problems 
do  in  fact  produce  sensible  results  in  most  applications  because  of 
the  inherent  continuity  properties  of  the  linear  program.  Unfortunate- 
ly, the  continuity  properties  that  characterize  LP  models  do  not  persist 
when  integer  restrictions  are  imposed.  Evidently,  great  care  must  be 
given  to  an  MIP  formulation  in  order  to  achieve  an  acceptable  formula- 
tion of  a real  world  problem;  sensitivity  amalysis  is  much  needed  as 
a means  for  determining  problem  behavior. 

Conditions  are  developed  that  assure  continuity  at  a point.  Point- 
to-set  mapping  theory  plays  a central  role;  with  reasonably  weak  assimp- 
tions  on  the  objective  function,  a discontinuity  in  optimal  value  is 
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possible  only  when  the  feasible  region  is  discontinuous  as  a point-to- 
set  map.  When  this  map  is  "closed"  the  optima]  value  is  a semicontinu- 
ous  function  of  the  data  so  that  a "small"  chiinge  in  data  cannot  create 
an  incommensurate  in^rovement  in  optimal  value;  this  property  always 
holds  for  bounded  linear  MIP  problems.  Continuity  in  the  linear  case 
is  assured  by  a single  post-optimal  set-interiority  condition.  Formula 
tion  methods  are  prescribed  that  mitigate  the  bogey  of  discontinuity  in 
some  problems. 

A general  approach  to  determining  sensitivity  is  described  based 
on  the  construction  of  linear  bounds.  Several  methods  are  given  for 
discovering  data  perturbations  that  provide  substemtial  improvements 
in  the  optimal  value.  With  respect  to  data  defining  the  feasible 
domain,  this  essentially  amounts  to  locating  points  of  discontinuity. 
Analysis  of  sensitivity  to  objective  function  data  is  especially 
straightforward  since  in  virtually  all  practical  discrete  optimiza- 
tion problems  the  optimal  value  is  continuous  (and  concave  in  most 
cases)  with  respect  to  such  data. 
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CHAPTER  1 

SENSITIVITY  ANALYSIS:  A PERSPECTIVE 


I 


I 
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One  of  the  most  worrisome  properties  of  mixed  Integer  programming 
(MIP)  problems  Is  the  plaguing  discontinuity  of  the  optimal  solution 
value  with  respect  to  problem  data«  a characteristic  that  Is  compara- 
tively Infrequent  (although  present)  In  continuous-varl2d}le  problems. 
With  minimization  problems  In  particular,  we  are  referring  to  the  possi- 
bility that  a slight  perturbation  In  the  data  defining  the  problem  may 
create  an  Incommensurately  large  reduction  In  the  optimal  value.  It 
will  be  shown  iiat  this  situation  can  occur  only  when  the  feetslble 
region  exhibits  a discontinuous  behavior  with  respecr  to  data  changes, 
provided  the  objective  function  Is  well-behaved.  Discontinuous  behavior 
of  the  optimal  value  and  optimal  solution  set  Is  a model  Instability 
that  cem  jeopardize  the  successful  managerial  application  of  NIP  models. 
Sensitivity  analysis  in  discrete  optimization  is  dedicated  to  the  iden- 
tification, interpretation,  and  alleviation  of  such  instabilities. 


1 

i 


1.1  Motivation  for  Sensitivity  Analysis 

Currently,  the  study  of  sensitivity  in  mixed  integer  programming  is 
ir  its  very  early  stages.  This  is  understandable  since  until  recently 
algorithms  for  solving  MIP  problems  were  relatively  inefficient  emd 
further  analysis  would  be  ein  overburdening  expense.  Fortunately,  the 
state-of-the-art  in  MIP  has  evolved  substantiedly  in  the  past  few  years 
and  it  is  hoped  that  this  treatise  will  mark  a genesis  of  sensitivity 
analysis  practices  2uid  will  spark  further  development  in  the  amalysls 
of  MIP  sensitivity.  A compendium  of  recent  advances  is  given  by 
Geoffrion  [I2l,  and  earlier  advances  are  surveyed  in  Geoffrion  and 
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Marst«n  [13] . 

Compared  with  continuous-variable  mathematical  programs  MIP  prob- 
lems demand  much  greater  concern  for  data  sensitivity  emd  for  model 
formulation.  The  reason  that  (continuous-variable)  LP  problems  do  in 
fact  produce  sensible  results  in  most  applications  is  due  to  the  in- 
herent continuity  properties  of  the  linear  progr£un  (see  Chapter  6) . 

That  is  to  say,  the  analyst  accepts  his  LP  formulation  of  the  problem 
as  an  adequate  representation  of  the  real  world  because  he  is  confident 
that  a small  change  in  data  will  permit  only  a small  change  in  the 
optimal  solution  value. 

Unfortunately,  the  soothing  continuity  properties  that  character- 
ize LP  models  do  not  persist  when  integer  restrictions  are  imposed. 
Consequently,  constraint  formulations  deemed  as  adequate  in  em  LP  model 
may  not  be  acceptedDle  in  a mixed  integer  model  in  the  sense  that  un- 
realistic discontinuities  ceui  occur.  Evidently,  greater  care  must  be 
given  to  the  formulation  of  an  MIP  problem  in  order  to  achieve  em 
acceptable  formulation  of  the  real  world. 

Practical  problems  that  are  formulated  as  mathematical  programs 
are  seldom  completely  solved  by  the  determination  of  a solution  to  the 
mathematical  program.  This  is  especially  true  for  linear  formulations 
because  they  so  frequently  express  lenient  approximations  to  the  real 
problem.  The  problem  data  are  the  link  between  reality  emd  the  model 
— seldom,  in  practical  problems,  are  the  data  truly  constant.  Conse- 
quently, it  is  ordinarily  advisable  to  perform  a sensitivity  analysis 
to  determine  the  effect  of  data  changes  on  the  optimal  solution  emd 
solution  value.  Based  on  sensitivity  analysis  results  the  analyst  may 
want  to  alter  the  data  slightly  or  perhaps  improve  the  model  formulation 
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so  as  to  remove  high  sensitivities. 


There  are  several  reasons  why  data  may  not  be  constant  and  why, 


therefore,  perturbations  in  the  data  must  be  investigated.  Perhaps  the 


most  conron  is  the  fact  that  data  is  seldom  known  with  certainty  — it 


is  estimated.  A data  point  may  be  an  approximation  based  on  statisti- 


cal samples;  it  may  be  stochastic  in  nature.  For  instance,  in  capital 


budgeting,  the  return  on  an  investment  portfolio  is  a prediction  based 


on  past  experience  and  expected  economic  influences. 


Another  comnon  property  of  data  is  that  it  varies  with  time. 


There  are  many  exeunples:  denn.nds  in  facility  location,  costs  of  food 


items  in  menu-plemning , the  availability  of  resources  in  resource  allo- 


cation, etc.  When  such  data  are  held  fixed  the  resulting  static  model 


is  meaningful  only  over  a short  period  of  time.  It  is  common  practice 


to  approximate  the  dynaumic  nature  of  a system  by  a sequence  of  static 


models,  solved  in  parametric  fashion  if  possible  (see  Nauss  [22]). 


Sensitivity  analysis  can  be  useful  in  run  design,  e.g.,  in  deter- 


mining the  direction  eind  size  of  a data  change  for  subsequent  static 


optimizations.  In  general,  the  data  may  vary  (slightly)  with  respect 


to  parameters  other  thaui  time,  perhaps  even  with  respect  to  variables 


explicit  in  the  model. 


Frequently,  data  are  allowed  to  vary  arbitrarily,  but  for  a price. 


Budgets  can  always  be  stretched  as  long  as  lending  institutions  are  in 


business;  additional  materials  needed  in  manufacturing  can  usually  be 


obtained,  perhaps  at  a premium  price,  warehouse  design  capacity  C2ui  be 


increased  by  accepting  an  alternative  design  with  a higher  construction/ 


operating  cost;  product  demand  requirements  might  be  reduced  but  with  a 


penalty  to  future  business. 
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When  such  data  are  modeled  as  oonstemts  it  is  usually  done  under 


the  preemption  that  small  data  perturbations  will  not  induce  incomnen- 
surately  large  changes  in  optimal  value.  This  permits  a sin^ler  model 
2uid  avoids  having  to  gather  the  additional  prices,  costs,  and/or  utili- 
ties which  would  be  needed  to  model  data  variations  explicitly.  The 
presumption  is  often  a b2id  one  for  MIP  models.  That  it  is  commonplace 
may  possibly  be  due  to  a false  sense  of  security  carried  over  from  LP 
modeling  practices. 

Another  situation  is  rathc^r  embarrassing  Out  it  occurs  nonetheless 
quite  frequently.  After  solving  the  problem  it  may  be  discovered  that 
a datum  is  wrong,  perhaps  a misplaced  decimal  point  or  a keypunch 
error.  Less  embarrassing  is  the  case  where  new  information  indicates 
that  the  estimates  of  certain  data  values  should  be  revised. 

We  have  just  identified  basically  fcur  types  of  data  that  motivate 
exercising  sensitivity  analysis: 

• data  with  uncertainty 

• dyneunic  data 

• subjective  data 

• wrong  data. 

Each  of  these  data  types  may  suggest  slightly  different  motives  for 
sensitivity  analysis.  In  the  case  of  uncertain  data  — which  result 
from  predictions,  physical  measurements,  statistical  sampling,  etc.  — 
the  analyst  is  concerned  first  with  stability f that  is,  some  assurance 
is  sought  that  small  changes  cibout  the  given  data  point  will  yield 
likewise  small  changes  in  optimal  value.  With  regard  to  physical  data 
which  represent  measurements,  assurance  of  stability  may  be  a sufficient 
objective;  but  depending  on  the  nature  of  the  data  the  analyst  may 
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desire  quantitative  information  on  the  variation  of  the  optimal  value 
and  solution  with  respect  to  prescribed  data  variations. 

In  some  cases,  particularly  with  dynamic  data  whose  fluctuations 
with  time  are  predictable,  the  sensitivity  emalysls  may  be  focused  on 
directional  changes  in  the  data.  Customer  demands,  for  exaitple,  might 
be  predicted  to  increase  proportionately  over  time,  in  which  case  the 
sensitivity  in  optimal  value  C6m  be  expressed  in  terms  of  time,  a 
scalar  quantity. 

Subjective  data  (managerial  and  operational  specifications,  gues- 
timates,  utilities,  etc.)  are  commonly  perturbable,  particularly  when 
a reasonable  change  in  such  data  can  be  shown  to  result  in  a sizable 
improvement  in  the  optimal  value.  A budgetary  limitation  might  be 
relaxed,  for  instance,  if  the  resulting  reward  favorably  exceeds  the 
cost  of  the  expanded  budget.  The  motive  in  this  case  appears  to  be  to 
discover  reasonable  perturbations  in  the  data  that  yield  net  improve- 
•nro't-s  in  optimal  value  (see  Chapter  11) . 

In  the  situation  where  data  are  discovered  to  be  in  error  after- 
the-fact,  the  subsequent  response  is  typically  a frantic  attenpt  to 
reconstruct  an  optimal  or  near-optimal  solution  from  the  erroneously 
derived  solution.  Bounds  on  the  deviation  in  optimal  value  (and  solu- 
tions corresponding  to  the  bounds)  may  possibly  be  the  best  that  can  be 
expected  from  a post-optimal  analysis;  the  methods  of  sensitivity  ^lna- 
lysis  can  be  of  some  assistance. 

1 . 2 The  Principal  Issues 

The  nature  and  cimount  of  sensitivity  information  desired  for  a 
particular  problem  depends  mainly  on  the  characteristics  of  the  data. 


5 


"Will  •”wi'«’ 


especially  the  degree  of  flexibility  of  the  data.  Data  that  are  flex- 
ible are  allowed  to  vary  substantially  from  their  specified  values, 
usually  at  some  additional  expense.  A data  point  that  is  permitted  to 
be  changed  by  one  or  more  percentage  points  can  certednly  be  regarded 
as  flexible.  Common  examples  of  flexible  data  are  budgets,  material 
supplies,  design  specifications  such  as  capacity,  production  levels, 
etc.  Flexible  data  can  be  viewed  as  model  parameters  whose  assigned 
values  may  be  reasonably  perturbed  if  the  net  payoff  for  doing  so  is 
substantial.  What  exactly  is  a reasonable  perturbation,  of  course,  is 
dictated  by  the  degree  of  data  flexibility.  Rigid  data  such  as  trans- 
port distcuices,  system  component  weights,  the  volume  of  an  available 
fuel  tank,  etc.,  obviously  have  little  or  no  active  role  in  a sensitiv- 
ity emaiysis. 

Given  the  problem  and  specified  data  values  the  first  question  per- 
haps is  whether  or  not  the  optimal  value  is  continuous  with  respect  to 
the  data.  This  is  the  question  of  stability;  unstable  behavior  must  be 
explained:  either  the  model  is  ein  inaccurate  representation  of  the 

real  world  or  there  is  some  physical  justification  for  the  behavior. 
Secondly,  depending  on  flexibility  of  the  data,  the  emalysis  may  be 
directed  toward  discovery  of  reasonable  data  perturbations  that  yield 
favorable  improvements  in  the  optimal  value. 

Identification  of  such  improving  data  chemges  and  their  correspond- 
ing optimal  values  provides  the  manager  with  a collection  of  alterna- 
tives that  can  be  analyzed  with  regard  to  utilities  and  complex  consid- 
erations that  were  not  represented  in  the  model.  In  addition,  the 
sensitivity  analysis  should  provide  interpretive  aids  over  and  above 
the  fact  that  a specific  data  change  buys  a specific  improvement  in 
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optimal  value,  such  as  rates  of  change,  bounds  on  the  amount  of  change, 
and  identification  of  critical  data  «md  critical  constraints. 

This  kind  of  sensitivity  information  is  useful  also  to  the  analyst 
should  he  decide  that  the  model  must  be  reformulated  to  achieve  greater 
realism.  Instabilities  (discontinuities)  that  are  Interpreted  as  due 
to  oversimplification  and  approximation  in  the  model  give  rise  to  the 
issue  of  how  such  modeling  inadequacies  may  be  alleviated.  If  a datum 
is  known  to  be  critical  (in  the  sense  that  it  is  responsible  for  an 
unrealistic  discontinuity)  then  its  replacement  by  a varieUsle  may  yield 
a satisfactory  reformulatiion  of  the  model.  Similarly,  critical  con- 
straints might  be  remodeled  by  relaxation  with  a violation  penalty  in 
the  objective  function.  Such  techniques  fcir  model  formulation  ^md  re- 
formulation aro  the  topic  of  Chapter  7. 

The  purpose  of  a sensitivity  analysis  is  to  investigate  one  or 
more  of  the  issues  posed  by  questions  such  as: 

(1)  Can  a small  change  in  the  data  permit  a relatively  large 
chcinge  in  the  optimal  value?  If  so.  which  data  and  which 
constraints  are  responsible? 

(2)  How  much  can  data  be  varied  without  creating  cm  incommensu- 
rate change  in  the  optimal  v?.lue  and  solution? 

(3)  What  particular  data  perturbations  permit  improvements  in 
the  optimal  value  emd  hew  much  improvemem,? 

(4)  What  is  the  rate  of  change  of  the  optimal  value  with  respect 
to  (componentwise  or  directional)  data  changes? 

(5)  In  the  case  of  parametrized  data,  what  is  the  approximate 
behavior  of  the  optimal  value  as  a function  of  the  data 
parameter? 
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Issues  one  and  two  are  si^remely  subjective  In  nature,  but  prltnarl- 
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ly  they  are  concerned  with  the  existence  of  discrete  juit^s  (discontinu- 
ities) in  the  optimal  value  that  occur  due  to  perturbations  in  the  data: 
is  the  optimal  value  discontinuous  at  or  very  near  to  the  given  data 
point?  If  not,  how  much  (and  in  what  manner)  can  the  data  be  varied 
without  permitting  emy  discontinuity  in  the  optimal  value?  The  second 
question  is,  of  course,  more  difficult  to  answer  them  the  first. 

The  third  question  asks  for  what  is  perhaps  the  most  that  can  be 
expected  from  a sensitivity  analysis:  a collection  of  alternative  data 

values  and  corresponding  inprovements  in  the  optimal  value.  However, 
for  certain  restricted  variations  in  data,  e.g.,  variation  of  only  one 
component  of  the  data  or  of  parametrized  data,  it  can  be  practical  to 
estimate  the  optimal  value  as  a function  of  the  scalar  parameter.  Thus, 
if  b + 0r  denotes  the  right  side  of  a set  of  inequality  constraints, 
the  objective  is  to  estimate  the  optimal  value  function  v(0)  over  a 
specified  range  of  values  for  0 (this  is  question  (5)). 

Some  insight  into  these  issues  of  sensitivity  analysis  is  provided 
by  the  illustrative  observational  analysis  in  the  next  section. 

1 . 3 An  Illustrative  Analysis  of  a Simple  Problem 

maximize  200y^  + 160Y2 

subject  to:  41y  + 39y  + 20y  + lOy.  ^ 80 

^ ^ ^ (1.1) 

30y^  + 25y2  + 20y^  + 15y^  ^ 70 

y^  = 0 or  1,  (i  = 1,2, 3, 4)  . 

The  two  budgets  will  be  referred  to  as  b^^  and  b^  (b^^  = 80,  = 

70)  ; let  c denote  the  objective  function  coefficients  and  let  v denote 
the  optimal  value  of  problem  (1.1).  For  the  given  values  of  b and  c. 
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V ■ 360  and  y*  ■ (1,1, 0,0)  is  uniquely  optimal. 

We  will  emalyze  the  sensitivity  of  v to  changes  in  b and  c with 
regard  to  questions  (1)  through  (5)  of  the  previous  section.  Because 
(1.1)  is  so  single  the  sensitivity  information  ceui  be  obtained  by  ob- 
servation. To  obtain  similar  information  for  more  complex  problems  will 
generally  require  computational  procedures  that  exploit  theoretical  con- 
tinuity 2uid  sensitivity  propeities.  This  brief  exercise  is  intended  to 
exhibit  the  primary  issues  of  a sensitivity  analysis  and  to  suggest  con- 
cepts and  procedures  that  generalize  to  more  conf>lex  applications. 

Consider  the  first  question:  can  a small  change  in  c or  b (or 

both)  cause  a large  in^rovement  in  v?  It  is  clear  that  v is  monotone 
nondecreasing  with  respect  to  increases  in  c.  It  is  also  easy  to  see 
that  V c2uinot  take  a discrete  jump  in  value  due  to  a change  in  c because 
any  solution  optimal  at  c is  feasible  for  any  (bounded)  perturbations  in 
c.  That  is,  V varies  continuously  with  respect  to  changes  in  c.  Fur- 
thermore, it  is  relatively  easy  to  derive  bounds  on  the  variation  in  v 
with  respect  to  changes  in  c (this  topic  is  studied  in  Chapter  9)  . 

Small  changes  in  b on  the  other  hand  cem  give  rise  to  discrete 
changes  in  v.  If  bj^  is  decreased  (from  80)  by  any  amount  however  small 
the  current  optimal  solution  y*  becomes  infeasible  and  v takes  a dis- 
crete jump  downward  (to  300).  However,  wc  are  mostly  interested  in 
data  changes  that  might  improve  the  optimal  value  (increases  in  b in 
this  case)  . Can  a small  increase  in  b admit  a solution  with  a much 
higher  optimal  value?  Consider  the  increased  budget  b = (85,75). 
Resolving  the  problem  (by  inspection  in  this  sinple  example}  , y*  = 

(1,1, 0,0)  is  found  to  still  be  optimal  so  that  v remains  equal  to  360 
for  increases  in  b of  roughly  6%  or  less. 
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Evidently,  for  problem  (1.1)  the  answer  to  question  (1)  is:  no,  a 

small  chemge  in  data  does  not  pecndt  a relatively  large  inprovement  in 
the  optimal  value  v.  At  this  point  the  analyst  either  is  satisfied 
that  his  problem  is  stable  with  respect  to  the  data,  or  he  is  interested 
in  )cnowing  how  much  (further)  the  data  cem  be  varied  without  producing 
a violent  ch2Uige  in  v or  a change  in  the  optimal  solution.  The  amount 
or  type  of  sensitivity  information  desired  by  the  analyst  depends  on 
the  rigidity  or  flexibility  of  the  data. 

Suppose  that  the  budgets  b^^  and  b^  could  at  some  per  unit  cost  be 

increased  by  as  much  as  5*  but  under  no  circumstauices  cruld  they  be 

stretched  by  more  than  5%.  In  this  case  the  analyst  is  content  with 
the  eUiswer  to  question  (1)  and  the  analysis  is  complete.  On  the  other 
hand,  suppose  that  the  budgets  may  be  stretched  by  as  much  as  20%  (for 
a price).  Now  the  analyst  will  want  to  continue  to  analyze.  How  much 
can  b be  stretched  without  causing  a jump  in  v?  This  is  question  (2). 

If  b^  is  increased  to  90,  y = (1,1, 0,1)  becomes  the  (unique)  opti- 
mal solution  for  a value  of  v = 400.  For  values  of  b^^  less  than  90 

(and  greater  than  80)  y*  = (1,1, 0,0)  and  v = 360  remain  optimal;  in 

fact,  they  are  optimal  for  all  b such  that  80  ^ b^  < 90  and  55  ^ < “• 

We  have  obtained  a partial  answer  to  question  (3);  an  increase  in 
b^  of  10  units  increases  v by  40.  In  addition,  we  find  that  increasing 
b to  (100,85)  increases  v by  60  (v  = 420  witli  y*  = (1,1, 1,0));  further 
increasing  b to  (110,100)  yields  v = 460  with  y*  = (1,1, 1,1). 

In  this  simple  exaiq^ie  it  is  clear  that  these  are  the  only  points 
of  discontinuity  that  con  result  by  allowing  b to  increase.  In  general, 
one  would  want  to  discover  those  points  of  discontinuity  that  arise 
from  reasonable  data  perturbations  and  that  provide  a net  improvement 
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In  thR  objective  value. 

Consideration  (4)  — the  rate  of  change  of  v — applies  only  to 
data  points  at  which  v is  continuous.  For  instance,  it  nudces  sense  to 
determine  the  rate  of  change  of  v with  respect  to  objective  function 
coefficients  since  (as  we  shall  formally  establish  later)  in  any  mixed 
Integer  program  v is  continuous  with  respect  to  such  data.  Because  v 


as  a function  of  c is  given  by  v(c)  ■ c*y*,  we  have  for  problem  (1.1) 
that  dv/dc  - y*  (i.e.,  dv/dc^  ■ 1,  dv/dc^  * 1,  dv/dc^  = 0,  dv/dc^  ■ 0) 
at  c > (200,160,60,40)  and  b > (60,70).  If  we  consider  parametric 
ch2uiges  in  c of  the  form  y'(1»1/1»1)  where  y ^0,  then  dv/dy  ■ 2 at  the 
given  values  of  c and  b. 

Rates  of  chjmge  of  v,  or  more  accurately,  directional  derivatives, 
are  of  interest  for  two  reasons.  First,  even  if  v varies  continuously 
with  respect  to  a (continuous)  change  in  data,  v can  be  highly  sensitive 
to  the  data.  This  sensitivity  is  measured  by  a directional  derivative. 
Secondly,  we  will  see  later  that  these  derivatives,  or  estimates  there- 
of, are  useful  in  procedures  for  discovering  points  of  discontinuity. 

Data  that  influence  the  feasible  region,  such  as  b^  and  b^  in 
(1.1),  are  responsible  for  any  discontinuity  in  v euid  in  the  feasible 


region  itself.  For  problem  (1.1),  let 


denote  the  rate  of  chemge 


of  v with  respect  to  increases  in  b . Similarly,  | is  a left-hand 
derivative.  At  b = (80,70)  we  have 


and  at  b = (85,75)  , both  derivatives  are  zero. 

In  pure  integer  problems  these  one-sided  derivatives  of  v with 


respect  to  a right-side  datum  are  always  either  zero  or  infinite  in 
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value.  We  will  find  these  derivatives  to  be  more  interesting  in  the 
mixed  integer  case. 

With  regard  to  question  (5)  , one  could  plot  v as  a function  of  y 
where  the  objective  function  coefficients  are  given  by  c + yc'  euid  b is 
held  fixed,  as  a function  of  B where  the  right  sides  are  b Bb'  and  c 

is  held  fixed,  or  as  a function  of  6 where  the  objective  coefficients 

and  right-side  parametrizations  are  c + 0c’  emd  b + 6b',  respectively. 
These  functions  — v(y)  , v(6),  and  v(0)  — for  problem  (1.1)  are  plotted 
in  Figures  1.1,  1.2,  and  1.3.  We  have  arbitrarily  selected  c'  * (-50, 
-40,30,25)  and  b'  = (30,25);  the  parameters  are  permitted  to  vary  from 
0 to  1. 

Notice  that  v is  continuous  as  a function  of  y but  is  discontinuous 
as  a function  of  B.  The  function  v(0)  is  also  discontinuous;  v(0)  is 
the  optimal  value  function  of  the  problem: 

meucimize  (2OO-5O0)yj^  + (16O-4O0)y2  + (6O+3O0)y^  + (4O+2O0)y^ 
s.t.  41y^  + 39y^  + 20y^  + lOy^  ^ 80  + 300 

30yj^  + 25y2  + 30y^  r 15y^  70  + 250 

y^  = 0 or  1,  (i  = 1,2, 3, 4)  . 

These  plots  were  obtained  by  observation;  methods  for  efficiently  ob- 
taining or  approximating  similar  plots  for  more  complex  problems  are 
studied  in  Chapters  9,  10,  cind  11. 

An  important  objective  in  the  development  of  computational  proce- 
dures is  to  format  the  sensitivity  information  in  a way  that  is  meaning- 
ful and  yet  is  easy  to  interpret.  The  sensitivity  issues  (1)  through 
(5)  of  paragraph  1.2  were  phrased  to  accommodate  this  objective.  For 
parametric  data  two-dimensional  plots  are  reasoncdDly  derivable  eind  easy 
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to  interpret.  For  nonparametric  data  functional  relationships  are  un- 
reasonably difficult  to  derive  and  to  interpret*  however,  a colloctior. 
of  alternate  data  points  that  yield  improved  solutions  is  reasonably 
obtainable  information. 


v(y) 


Figure  1.1.  Problem  (1.1)— v as  a Function  of  Parametric  Costs 


v(6) 


Figure  1.2.  Problem  (1.1)— v as  a Function  of  Parametric  Right-Sides 
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v(0) 


Fiyure  1.3.  Problem  (1.1) — v as  a Function  of 
Parametric  Costs  and  Right-Sides 


1 . 4 Conventional  Means  for  Deriving  Sensitivity  Information 

It  is  instructive  to  look  briefly  at  various  conventional  methods 
for  deriving  sensitivity  information  and  to  reflect  upon  these  methods 
with  regard  to  their  usefulness  in  the  context  of  mixed  integer  pro- 
gramming. Four  broad  (not  necessarily  disjoint)  approaches  for  deriving 
information  from  a mathematical  progrcunming  model  are: 

(A)  Repetition  of  the  optimization  with  different  input  data 

(B)  Quantitative  analysis  of  solution  output 

(C)  Post-optimal  analysis 

(D)  Sequential  run  design. 

The  first  method,  repetition,  involves  making  several  runs  with 
perturbed  data.  Sensitivity  information  is  then  gleaned  from  a compari- 
son of  the  alternate  solutions.  Repetition  is  common  in  simulations. 

At  times  it  may  be  desired  only  to  compare  alternate  solutions  with 
regard  to  variables  external  to  the  model.  Application  of  parametric 


14 


J 


prograiTRilng  techniques^  could  make  this  brute  force  method  more  attrac- 


tive. 

The  second  method  is  available  in  many  optimization  codes.  In 
particular,  the  optimal  dual  varied) les  in  an  LP  problem  describe  mar- 
ginal costs  or  benefits  of  implementing  a nonoptimal  policy  or  of  modi- 
fying the  constraints.  In  the  LP  case  this  information  is  free.  In 
nonlinear  (continuous- variable)  problems  that  are  solved  via  an  LP-based 
algorithm,  the  dual  variadsles  (from  the  LP  subproblem)  can  saietlmes  be 
transformed  to  represent  meaningful  sensitivities.  Attempts  to  derive 
meaningful  duals  for  MIP  problems,  however,  have  not  been  fruitful.  It 
appears  that  2m  MIP  analysis  based  solely  on  analysis  of  the  solution 
output  could  produce  only  very  limited  sensitivity  information.  More 
will  be  said  on  this  topic  in  later  chapters. 

Post-optimal  analysis  is  distinguished  from  the  second  method  in 
that  it  usually  involves  algorithmic  modification,  particularly  of  the 
final  stage  of  the  solution  process.  The  usual  style  of  post-optimal 
analysis  is  the  derivation  of  sensitivities  via  (partial)  reoptimiza- 
tion. Again  using  LP  as  an  exanple,  effects  on  the  optimal  value  of 
slightly  varying  certain  data,  of  fixing  variediles,  and  tightening  or 
relaxing  constraints  are  determined  by  reoptimization.  This  repetitive 
type  of  analysis  is  distinguished  from  method  (A)  in  that  it  exploits 
the  optimal  solution  and  auxiliary  output  in  order  to  hasten  successive 
optimizations. 

A post-optimal  analysis  eit^jloys  techniques  to  efficiently  reopti- 


mize when  slight  perturbations  are  made  to  the  original  problem.  The 


See  Nauss  [22]  . 
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efficiency  of  such  analysis  depends,  of  course,  on  the  nature  and  mag- 
nitude of  the  perturbations  to  he  studied}  these  may  be  such  that  the 
analysis  procedure  is  degrade*'!  to  the  point  of  being  nothing  more  than 
a repetition  of  runs  (i.e.  , total  reoptimizations) . Unfortunately,  the 
relation  between  efficie.icy  of  reoptimization  emd  the  "magnitude"  of 
problem  perturbations  can  usually  be  assessed  only  after  considered^le 
experience  with  similar  problems  has  been  gained. 

Run  design  refers  to  the  judicious  sequencing  of  problems  in  order 
that  the  desired  information  is  gained  by  executing  an  efficiently 
small  number  of  runs.  Successive  problems  are  normally  determined  in 
sequential  fashion  and  depend  on  the  current  status  and  type  of  infor- 
mation desired.  The  sequencing  of  problems  should,  of  course,  exploit 
reoptimization  advantages  by  utilizing  techniques  '>f  post-optimal  ana- 
lysis and  parametric  programming  whenever  applicaJsle.  Run  design  — 
better  known  as  experimental  nin  design  — is  popular  in  t’  e analysis 
of  problems  of  statistical  nature;  concepts  of  run  design  in  the  con- 
text of  discrete  optimization  will  be  more  clearly  ested^lished  and 
understood  as  the  theory  in  Part  II  is  unfolded  (a  good  portion  of  the 
methodology  presented  in  Part  II  cein  be  regarded  as  run  design)  . 

These  methods  may  be  regarded  as  conventional  when  applied  to  con- 
tinuous-variable problems,  but  in  the  treatment  of  discrete  optimiza- 
tion problems  there  are  presently  no  techniques  (other  than  repetition) 
that  can  be  called  conventional.  The  state-of-the-art  is  discussed  in 
paragraph  1.6. 

1 . 5 Connections  Between  Continuity  Theory,  Sensitivity  Analysis,  and 

Parametric  Programming 

Continuity  theory,  the  topic  of  Part  I of  this  thesis,  is  the 
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formal  basis  for  sensitivity  analysis.  It  serves  to  justify  many  of 
the  techniques  examined  in  Part  II.  Naturally,  the  extensiveness  and 
procedural  details  of  a sensitivity  analysis  will  depend  on  the  inherent 
continuity  properties  of  the  model,  provided  that  these  properties  are 
known  or  can  be  assessed  prior  to  conducting  the  entire  analysis. 

Later  on  we  will  identify  several  broad  classes  of  models  that 
possess  favorable  continuity  properties  over  all  "interesting"  data 
values.  For  these  models  it  is  likely  a straightforward  task  to  approx- 
imate or  determine  bounds  on  the  fluctuation  in  the  optimal  value  v 
with  respect  to  changes  in  the  data.  In  other  words,  models  that  are 
known  or  are  determined  to  have  nice  continuity  properties  permit  a 
different  and  usually  less  conplicated  analysis  approach  than  do  models 
that  are  known  or  are  suspected  to  exhibit  discontinuous  behavior. 


Consequently,  the  approach  that  is  taken  to  analyzing  sensitivity  will 
depend  on  an  assessment  of  the  continuity  properties  of  the  mode’  . 

Not  only  will  the  choice  of  approach  depend  on  continuity  proper- 
ties of  the  model,  but  the  approach  itself  may  rely  extensively  on  con- 
tinuity considerations.  In  particular,  issue  (3)  of  paragraph  1.2  in- 

*/  t/ 

volves  discovering  data  points-'  that  are  points  of  discontinuity.-' 

Conditions  for  continuity/discontinuity  derived  in  Part  I will  prove  to 
be  instrumental  in  constructing  means  for  deriving  points  of  disconti- 
nuity that  permit  a net  improvement  in  optimal  value. 

The  first  issue  stated  in  paragraph  1.2  is  addressed  completely  by 

__ 

— A data  point  is  a set  of  values  for  all  data. 

^ In  Figures  1.2  cUid  1.3,  for  instance,  the  points  of  discontinuity  are 
of  primary  interest  because  they  correspond  to  minimal  data  perturba- 
tions that  can  yield  discrete  improvements  in  optimal  value. 
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the  theory  of  continuity.  If  a discontinuity  is  recognized,  the  criti- 
cal data  and  critical  constraints  can  be  identified  by  observing  which 
data/constraints  violate  the  conditions  for  continuity.  Identification 
of  critical  data  and  constraints  is  particularly  motivated  by  a need  to 
reformulate  the  model. 

Falling  to  establish  continuity  in  a model,  the  walyst  will  want 
to  identify  points  of  discontinuity  for  the  purposes  of  either  altering 
the  data  to  improve  the  objective  value  or  of  modifying  the  model  toward 
greater  realism.  The  task  of  identifying  discontinuities  or  verifying 
that  there  are  none  in  the  domain  of  interest  could  be  accomplished  by 
systematically  varying  the  problem  data  over  the  region  of  interest  and 
solving  the  resulting  collection  of  closely  related  problems. 

Such  a collection  of  related  problems  is  referred  to  as  a paramet- 
ric Integer  program  and  the  development/application  of  conputational 
methods  for  efficiently  solving  a fiunily  of  integer  problems  is  referred 
to  as  parametric  Integer  progreunming.  Pa’*ametric  progreunming  in  dis- 
crete optimization  is  a new  field?  the  study  by  Nauss  [22]  of  parametric 
integer  linear  programming  is  apparently  the  first  substemtial  contribu- 
tion to  this  field. 

Thus,  parametric  programming  can  be  viewed  here  as  a technique  to 
which  the  2malyst  can  resort  for  analyzing  continuity  and  sensitivity. 
However,  it  is  a purpose  of  this  treatise  to  present  approaches  to  ana- 
lyzing continuity  and  sensitivity  that  are  far  more  efficient  th^ul  a 
brute  force  repetition  of  problem  solving,  whether  or  not  such  repeti- 
tion utilizes  techniques  of  parametric  programming.  This  is  not  to 
imply  that  efficient  analysis  techniques  will  be  completely  divorced 
from  parametric  programming;  on  the  contrary,  whenever  an  analysis 
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problem  involves  solving  a sequence  of  related  MIP  problems,  advantage 
should  be  taken  of  the  applicable  parametric  programnlng  techniques. 

Typically  parametric  progreunmlng  addresses  par2unetric  cost  rows  of 
the  form  c + yp  and/or  parametric  right  sides  of  the  form  b + 0r  where 
Y and  6 are  scalar  parameters.  In  this  context  there  are  two  categor- 
ies of  parametric  programming  considerations: 

(A)  Solve  the  finite  ntmber  of  similar  MIP  problems  that  corres- 
pond to  specified  values  of  the  parameter. 

(B)  Explore  the  solutions  that  result  when  the  parameter  Is 
allowed  to  vary  continuously  within  the  interval  [0,11. 

A third  consideration  requires  analysis  of  nonparametrlc  data: 

(C)  Discover  (nonpareunetrlc)  data  perturbations  that  permit  net 
improved  optimal  solution  values. 

Paramecric  integer  programming  is  limited  primarily  to  category 
(A);  the  difv.'ci’lty  with  (B)  and  (C)  type  problems  is  that  a sequence 
of  pr^>7lems  to  be  solved  cannot  be  specified  a priori.  Techniques  for 
handling  these  latter  problems  are  particular  topics  to  be  addressed  by 
the  study  of  sensitivity  theory  and  analysis. 

It  is  not  uncommon  that  parametric  problems  having  type  (B)  or  (C) 
objectives  are  re  -ait  into  the  type  (A)  format  due  to  unavailability  of 
appropriate  analysis  procedures.  For  instance,  a manager  may  actually 
want  to  find  (nonpareune*  ric)  perturbed  data  values  that  yield  substan- 
tial net  improvements  in  optimal  value,  but  for  lack  of  2ui  available 
(efficient)  approach  to  the  problem  he  invokes  the  brute  force  plan  of 
solving  the  problem  at  several  arbitrarily  selected  points. 

The  contact  between  sensitivity  analysis  and  parametric  programming 
can  be  made  more  explicit  once  the  theory  of  sensitivity  euid  analysis 


procadures  hav*  been  presented.  Further  connents  on  this  topic 
are  made  in  the  chapters  of  Part  II.  Likewise  i greater  appreciation 
for  the  significance  of  oontinulty  theory  and  its  role  in  sensitivity 
analysis  will  be  gained  in  Part  II. 

1.6  The  State-of-the-Art 

Theory  and  procedures  for  sensitivity  analysis  in  (continuous) 
li  ear  programming  were  developed  over  20  years  ago.  Among  the  first 
treatments  of  this  subject  were  Manne  [20]  and  Gass  emd  Saaty  [10,11]. 
Comprehensive  treatments  of  LP  sensitivity  analysis  ^ire  given  in  Gass 
[ 9 ] , Simnonard  [28] , and  Dinkelbach  [ 6 ] , and  basic  LP  sensitivity 
properties  are  offered  in  almost  every  LP  text. 

In  the  earliest  attempts  to  derive  integer  solutions  it  was  natural 
to  exploit  LP  theory  for  any  possible  extensions  and  modifications  that 
might  lead  to  acceptable  solution  procedures.  In  m^my  economic  ind 
production  plemning  models  the  discrete  variaibles  are  allowed  to  take 
on  quite  large  values  (e.g.,  100);  rounding  eai  LP  solution  = 99.87 
to  100  likely  is  a good  heuristic  in  this  case,  emd  in  general,  modify- 
ing em  LP  solution  sometimes  can  provide  a good  suboptimal  solution  to 
the  integer  problem.  When  this  is  the  case,  LP  sensitivity  analysis 
can  be  put  to  use  to  estimate  sensitivity  in  the  integer  problem.  Along 
these  lines  is  the  work  of  Gomory  [14],  first  published  in  1958,  and 
apparently  the  first  serious  treatment  on  the  derivation  euid  analysis 
of  integer  solutions.  Similar  modest  beginnings  in  the  analysis  of 
integer  programs  that  are  based  on  (continuous)  LP  solutions  include 
Freuik  [8],  Jensen  [19],  emd  Aronofsky  [2]. 


The  limitations  of  any  procedure  based  on  LP  solution  modification 
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should  be  obvious « especially  when  applied  to  decision  models  with  an 
abundance  of  0-1  varleibles.  It  can  be  a trying  task  to  massage  an  LP 
solution  Into  one  that  Is  Integer  feasible,  much  less  one  that  Is  near- 
optimal.  In  general,  an  attenpt  to  derive  an  Integer  solution  by  modi- 
fying the  LP  solution  must  be  assessed  a failure  whenever  the  numerical 
difference  between  the  LP  solution  value  and  the  manufactured  Integer 
solution  value  exceeds  an  acceptable  tolerance  of  error.  This  being 
more  often  the  case  than  not  In  discrete  optimization  problems,  we  must 
concede  to  the  fact  that  LP-based  sensitivity  analysis  provides  little 
or  no  assistance  In  the  ainalysls  of  discrete  optimization  problems. 

The  dlff.culty  In  analyzing  sensitivity  In  MIP  problems  Is  due 
primarily,  of  course,  to  the  discontinuous  behavior  of  v with  respect 
to  problem  data,  a property  that  rarely  arises  in  continuous-variedsle 
LP  problems.  The  size  of  the  "jumps"  in  v ^md  the  proximity  of  the 
points  of  discontinuity  are  virtually  impossible  to  predict.  The  ana- 
lyst must  resort  to  computational  methods  for  discovering  points  of  dis- 
continuity and  estimating  the  size  of  the  discrete  jun¥>s. 

Evidently,  no  procedures  are  presently  availed)le  for  sensitivity 
cinalysls  of  MIP  problems,  with  the  exception  of  the  linear  MIP  problem 
with  parametrized  objective  function.  Since  changes  in  objective  func- 
tion data  do  not  influence  the  feasible  region,  v has  characteristics 
much  like  those  of  the  continuous-variable  LP  counterpart  (piecewise- 
linear  and  concave)  and  can  be  studied  via  procedures  derived  for  LP 
problems  such  as  are  described  by  Hass  and  Saaty  [10,111  . A theoreti- 
cal approach  to  estimating  v for  parametrized  objective  function  data 
in  the  context  of  linear  MIP  is  detailed  by  Noltemeier  [23]. 


To  the  knowlidge  of  this  author,  the  first  serious  treatise  on 


21 


■ensltlvlty  analysis  for  pure  and  mixed  integer  programming  problems 
available  in  the  literature  was  Noltemeier  (23] . Except  for  the  objec- 
tive function  parametrization  mentioned  above,  however,  the  material  is 
oriented  toward  abstract  and  theoretical  (but  elementary)  properties 
that  do  not  contribute  to  the  more  practical  point-of-view  taken  here. 

No  conputational  aspects  are  mentioned.  Some  of  the  results  in  (23l  cein 
be  strengthened  by  imposing  a boundedness  assumption  on  the  feasible 
variable  space  (which  in  practice  is  not  really  a restrictive  assump- 
tion) . A substantial  portion  of  the  theory  concerns  the  ’’characteris- 
tic  cone,"  which  has  no  significamce  in  the  bounded  case  since  it  de- 
generates to  a point  (the  origin).  In  any  case,  the  pertinent  theory 
presented  in  [23]  is  subsumed  in  the  theory  that  we  present  in  this 
treatise. 

Sensitivity  in  integer  programs  is  approached  in  Bowman  [4]  from  a 
group  theoretic  point-of-view.  The  practicality  of  this  approach  has 
not  been  established,  however. 

A different  kind  of  approach  that  can  be  considered  within  the 
realm  of  sensitivity  analysis  for  integer  programs  is  taken  by  Piper 
and  Zoltners  [24,25].  They  describe  an  adjunct  to  inqplicit  enumeration 
schemes  that  generates  the  K best  e-optimal  solutions.  Such  a collec- 
tion can  be  useful  in  considering  variations  in  the  data  of  the  original 
problem. 

Roodmeui  [26,2  7]  describes  em  adjunct  to  enumerative  LP-based  MIP 
algorithms  that  provides  limited  (single  component)  ranging  amalysis  on 
particular  parameters.  Jensen  [19]  illustrates  by  way  of  a particular 
example  the  difficulties  encountered  when  attempting  a r2inging  analysis 
of  an  integer  problem. 
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Another  approach  to  obtaining  MIP  sensitivity  information  that 
appears  to  have  been  cast  aside  is  the  ?onf>utation  (r^ imputation)  of 
useful  dual  prices.  The  first  paper  to  address  this  topic  was  Gomory 
and  Baumol  [15]  wherein  a method  was  proposed  for  the  distribution  of 
dual  values  associated  vith  cutting  plcmes  to  the  original  constraints 
of  the  problem.  The  method  is  intimately  tied  to  the  method  of  integer 
forms  of  Gomory  [14].  Unfortunately,  the  reimputed  duals  have  severe 
shortcomings?  their  numerical  values  generally  depend  on  the  choice  of 
cutting  planes  and  a complete  history  of  the  added  constraints  is  re- 
quired for  the  recomputation;  they  display  a sizable  duality  gap  if 
interpreted  as  a dual  solution;  etc.  A detailed  critique  of  the  Gomory 
and  Baumol  method  is  given  by  Weingartner  [29].  Weingartner  also  pre- 
sents an  alternative  approach  in  the  context  of  capital  budgeting  prob- 
lems that  does  not  require  record  keeping  of  the  cutting  pl6mes;  the 
alternate  duals  are  obtained  from  LP  solutions  and  possess  a greater 
degree  of  uiiiqueness  than  do  the  Gomory-Baumol  duals,  but  they  have  a 
few  other  interpretive  deficiencies.  Alcaly  and  Klevorick  [1]  also  pre- 
sent some  methods  by  which  the  duals  can  be  improved  to  be  more  meaning- 
ful. Hespel  [16]  summarizes  the  accomplishment  in  this  area  and  offers 
still  6Uiother  inprovement,  but  yet  sever?  discrepancies  in  the  reimputed 
dual  prices  persist  and  meaningful  interpretation  is  open  to  question. 
All  of  these  treatments  are  based  on  Gomory 's  method  of  integer  forms 
for  solving  integer  programming  problems.  Additional  comments  on  this 
topic  are  offered  in  Appendix  lOA. 

Except  for  recent  work  by  Williams  [31]  , the  study  of  continuity  in 
MIP  problems  has  been  limited  to  the  reimputation  and  interpretation  of 
dual  prices.  Williams  estadslishes  some  basic  continuity  results  euid 
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reconunends  penalty  functions  as  a remedy  for  handling  constraints  that 


are  likely  to  allow  unrealistic  discontinuities.  No  procedures  or  im- 
plementation guidelines  are  given,  however. 

A considerable  amount  of  literature  is  avail£±>le  dealing  with  con- 
tinuity of  linear  and  nonlinear  continuous-variable  programs.  Foremost 
in  this  area  are  the  papers  by  Evans  2uid  Gould  t 7 ) ; Meyer  [2ll  ; 

Hogan  (18J  ; D2Uitzig,  Folkman  and  Shapiro  fSl.  These  studies  exploit 
the  use  of  point-to-set  mapping  theory  established  primarily  by  Zangwill 
[32,33]  and  Berge  [3].  Williams  [30]  relates  a form  of  directional 
continuity  to  boundedness  of  the  primal  and  dual  solution  sets  (and  to 
the  equivalent  regularity  conditions);  Hoffman  and  Karp  [17]  establish 
LP  continuity  with  respect  to  all  parameters  in  terms  of  the  same  con- 
ditions. 

Application  of  point-to-set  mapping  theory  to  mathematical  program- 
ming is  given  by  Hogein  [18] . Conditions  esteuDlishing  continuity  of 
extremal  value  functions  and  properties  of  maps  determined  by  inequali- 
ties are  included. 

1 . 7 The  Plem  of  the  Paper 

The  treatment  of  sensitivity  euialysis  in  mixed  integer  programming 
is  presented  in  two  parts.  Continuity  theory  is  addressed  in  Part  I, 
which  serves  as  a foundation  upon  which  to  build  analysis  procedures. 
Sensitivity  theory  and  analysis  techniques  are  presented  in  Part  II. 

The  main  enphasis  is  on  sensitivity  to  right-side  data.  We  will 
elaborate  only  briefly  on  the  general  content.  A more  detailed 
synopsis  is  given  in  the  introduction  to  each  part. 
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The  bulk  of  the  material  applies  to  nonlinear  MIP  problems  in  gen- 
eral, but  care  is  taken  not  to  overlook  special  properties  of  linear 
problems.  Evidently,  much  of  the  theory  of  continuity  that  applies  to 
linear  MIP  problems  can  be  extended  to  convex  programs;  nevertheless, 
in  order  to  encapsulate  the  linear  theory  a special  chapter  in  Part  I 
is  dev'  continuity  in  linear  MIP  problems.  Likewise,  the  amaly- 

sis  considerations  of  Part  II  apply  in  general  to  nonlinear  problems 
and  any  particular  advantages  that  occur  in  the  linear  case  are  pointed 
out. 

The  theory  of  continuity  is  based  on  point-to-set  mapping  theory 
[3,18,32,33]  • Thus,  the  set  of  feasible  variable  values  is  viewed  as  a 
mapping  of  the  data  point  (i.e.,  the  data  defining  tlie  model)  into  the 
feasible  region.  Continuity  of  the  optimal  value  and  optimal  solution 
set  as  functions  of  the  data  is  expressed  in  terms  of  set-interiority 
conditions  cu.J  continuity  properties  of  the  constraint  and  objective 
functions. 

Sensitivity  analysis  theory  and  procedures  presented  in  Part  II 
emphasize  three  classes  of  data:  objective  function  data,  parametric 

right-side  data,  and  nonparametric  right-side  data.  Sensitivity  analy- 
sis with  respect  to  nonparametric  data  permits  arbitrary  perturbation 
of  the  data.  The  trite  consideration  given  to  constraint  function  data 
is  justified  by  the  observation  that  the  major  concerns  with  this  data 
can  be  addressed  in  terms  of  the  right-side  data. 
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• Fundamental  Continuity  Properties  of  Nonlinear  MIP  Problems 

• Interiority  Conditions  of  Continuity  in  Nonlinear  MIP  Problems 

• Continuity  Properties  of  Convex  MIP  Problems 
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CHAPTER  2 


INTRODUCTION  TO  PART  I 

A mathematical  program  with  Integer  restrictions  on  some  of  the 
variables  is  much  more  likely  to  exhibit  discontinuous  behavior  in  opti- 
mal value  with  respect  to  problem  data  than  the  counterpart  problem 
where  none  of  the  variables  are  restricted  to  be  integer.  When  a small 
perturbation  in  the  data  results  in  an  incommensurate  change  in  the 
optimal  value,  the  analyst  will  likely  W2mt  to  alter  the  data  and/or 
the  model.  If  the  discontinuity  is  realistic,  he  may  wemt  to  slightly 
alter  the  data  in  order  to  discretely  improve  the  objective;  if  unreal- 
istic, he  may  need  to  improve  the  model  artfully  so  that  it  adequately 
represents  the  real  problem.  When  a program  is  determined  to  be  con- 
tinuous at  the  given  data  point  the  analyst  is  then  in  a position  to 
determine  further  sensitivity  properties  of  the  optimal  value. 

The  emalyst  using  MIP  models  and  codes  will  want  to  extend  his 
interest  beycnd  the  derivation  of  an  optimal  solution  and  value;  typi- 
cally, he  will  be  interested  first  in  knowing  which  data  changes,  if 
any,  can  yield  discrete  changes  in  the  optimal  value.  Investigation  of 
this  question  will  be  referred  to  as  continuity  analysis,  the  topic  to 
which  Part  I is  devoted. 

2 • 1 Content  and  Summary 

Conditions  are  developed  for  the  general  bounded  mixed  integer 
programming  (MIP)  problem  that  assure  continuity  at  a point.  Point-to- 
set  mapping  theory  plays  a central  role:  with  reasonably  weak  assump- 

tions on  the  objective  function,  a discontinuity  in  optimal  value  is 
possible  only  when  the  feasible  region  is  discontinuous  as  a point-to- 
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set  map.  When  this  map  Is  "closed"  the  optimal  value  is  a semlcontinu- 
ous  function  of  the  data  so  that  a small  chemge  in  data  cannot  create 
an  incommensurate  inprovement  in  optimal  value;  this  property  always 
holds  for  bounded  linear  MIP  problems.  Continuity  in  the  linear  case 
is  assured  by  a single  post-optimal  set-interiority  condition. 

The  fundamental  conditions  for  continuity  in  MIP  problems  axe  de- 
veloped in  Chapter  3.  The  treatment  by  Hogem  [16]  of  point-to-set  maps 
in  mathematical  progreunming  is  the  prime  source  of  theory  upon  which 
the  first  results  of  this  chapter  are  based.  Also  included  in  this 
chapter  is  a result  concerning  directional  continuity  that  has  an  im- 
port2uit  implication  in  continuity  emalysis;  essentially,  this  result 
states  that  the  optimal  value  v is  continuous  with  respect  to  all  data 
if  it  is  continuous  in  a certain  direction  with  respect  to  the  right- 
side  data. 

The  condition  that  a point  lie  in  the  interior  or  relative  interi- 
or of  its  domain  is  referred  to  as  interiority.  Two  domains  are  of 
interest:  the  set  of  points  in  variable  space  which  are  feasible  in 

the  MIP  problem  at  the  specified  data  point  (i.e.,  the  feasible  region), 
and  the  set  of  data  points  for  which  the  corresponding  feasible  region 
is  not  enpty.  The  latter  set  is  referred  to  as  the  "data  set."  If  con- 
tinuity holds  at  a data  point  a in  the  continuous-varieible  problem  that 
results  when  the  discrete  variables  are  held  fixed  at  optimal  values, 
and  if  a is  in  the  interior  of  the  data  set,  then  v is  continuous  with 
respect  to  the  data  at  the  point  a.  A similar  statement  holds  when 
data  set  interiority  is  replaced  by  the  stronger  condition  of  feasible 
region  interiority,  which  will  be  referred  to  as  "strong  feasibility." 
Interiority  conditions  for  continuity  are  the  subject  of  Chapter  4. 
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TVic  reaults  apply  in  general  io  nonj  inear  MIP  problemr. 

Specializations  to  the  convex  and  linear  cases  are  made  in  Chap- 
ters 5 and  6,  respectively.  The  conditions  for  continuity  simplify 
especially  in  the  linear  case  because  of  the  favoradsle  continuity  prop- 
erties of  LP  problems.  A summary  of  LP  continuity  properties  is  offered 
in  Chapter  6. 

Currently,  there  is  a great  deal  of  interest  in  linear  MIP  and 
comparatively  little  in  nonlinear  MIP;  the  reasons  are  uiiderstandable . 

But  this  does  not  mean  that  the  usefulness  of  sensitivity  theory  can  be 
construed  with  a proportionate  bias  toward  the  linear  case.  The  pri- 
mary support  for  this  claim  is  the  fact  that  linear  MIP  problems  are 
frequently  the  result  of  a linearization  process  applied  to  a nonlinear 
program.  Grcmted,  the  analyst  is  concerned  with  sensitivity  properties 
of  the  derived  linear  MIP,  but  he  is  also  interested  in  the  properties 
of  the  original  program.  In  this  case  the  analyst  requires  only  a 
linear  MIP  code  but  he  desires  more  general  sensitivity  theory. 

In  further  support  of  studying  nonlinear  theory,  the  evolution  of 
specialized  (e.g.  , convex)  nonlinear  MIP  codes  places  greater  demand  on 
a general  theory  of  continuity  and  associated  computational  sensitivity 
analysis  procedures.  More  importantly,  the  prior  existence  of  such 
theory  could  prove  to  be  of  great  assistance  to  the  modeler  as  he 
attempts  to  construct  a realistic  formulation  of  the  problem. 

Much  of  the  content  of  Chapters  3,  4,  5 and  6 is  directed  toward 
the  development  of  conditions  which  assure  that  v is  continuous,  i.e., 
sufficient  conditions.  Conditions  that  establish  a discontinuity,  on 
the  other  hand,  are  not  as  accessible.  Violation  of  the  sufficient 
conditions  for  continuity,  however,  is  strong  evidence  of  a discontinuity. 
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of  course,  assuremce  of  a discontinuity  can  be  gained  by  computational 
measures  if  necessary.  In  some  cases,  conditions  are  expressed  that 
are  both  necesseury  emd  sufficient. 

Once  confronted  with  a discontinuity,  the  analyst  is  obliged  to 
explain  the  bizarre  behavior.  Is  the  model  an  inaccurate  representa- 
tion of  the  real  world?  What  data  and/or  which  constraints  are  res- 
ponsible for  causing  the  discontinuity?  How  can  the  model  be  rsade  more 
realistic?  Quite  probably  some  of  the  apprehension  in  the  use  of  MIP 
codes  and  models  is  due  to  the  fact  that  so  little  is  known  about  MIP 
continuity  properties  and  their  implications  in  modeling  and  computa- 
tion. 

Chapter  6 exploits  the  implications  of  continuity  theory  in  the 
formulation  of  MIP  models.  In  the  formulation  of  a linear  capital  in- 
vestment problem,  for  example,  a budgetary  limitation  is  imposed  as  a 
constrednt  which  expresses  that  the  total  capital  invested  cannot  ex- 
ceed a prescribed  number,  say  b.  Thus,  euiy  investment  plan  is  precluded 
which  exceeds  the  budget  b by  an  arbitrarily  small  amount.  Williams 
(22]  points  out  that  such  a model  does  not  reflect  the  reeil  world  fact 
that  a budget  can  always  be  stretched  a little  if  just  a small  addi- 
tional amount  of  capital  is  needed  to  provide  a much  better  investment 
plan.  Evidently,  when  integer  restrictions  are  placed  on  some  of  the 
variables,  greater  care  must  be  given  to  the  formulation  of  an  MIP 
problem  in  order  to  achieve  2ui  acceptable  representation  of  the  real 
world. 

To  recapitulate.  Part  I (Chapters  3 through  7)  addresses  the  fol- 
lowing primary  considerations  of  continuity  analysis: 
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(A)  Can  a small  change  in  data  yield  a substwtlal  ch^ulge  In 
the  objective  value? 

(B)  What  data  and  which  constraints  are  responsible  for  a dis- 
continuity? 

(C)  How  may  the  model  be  improved? 


2.2  Terminology  and  Definitions 


We  address  the  following  generic  MIP  problem: 


minimize  f(a;x,y) 
subject  to:  (x,y)  c B(a) 


X e X 


y E Y 


a denotes  the  vector  of  data  (a  e E ) 


X denotes  the  continuous  variables 


y denotes  the  discrete  variables 

X is  a compact-^  set  in 

. . */  q 

Y IS  a finite—  set  in  E^ 


f:E  xXxY-*-E. 


The  optimal  value  of  problem  (I)  at  a is  denoted  by  v(a) 


Thus ^ 


v(q)  = minimum  f (a;x,y)  | (x,y)  e B(a)  . 
xeX,yeY 

The  set  of  e-optimal  solutions  at  a is  denoted  by 


M^(a)  H {(x,y)  e F(a)  |f (o;x,y)  ^ v(o)  + e} 


V .... 

— ' These  are  not  severely  restrictive  assumptions  in  practice  since 

practical  variable  bounds  are  usually  obvious. 

^"Minimum"  in  place  of  "infimum”  is  permissible  because  of  boundedness. 


where  the  feasible  region,  F(a),  is  given  by 


F(a)  = B{a)  n (X  X y)  . 


The  set  A of  all  values  a which  admit  a feasible  solution  to  problem 
(I)  is  given  by 

A E {a  e E^|f(o)  y 0}  . (2.4) 

When  the  y-variables  are  held  fixed  at  y e Y,  the  corresponding 
subproblem  is  given  as 


^minimize  f(a;x,y) 
xeX 

^subject  to:  (x,y)  e B(a)  . 


Accordingly,  we  define 


v^(a)  = optimal  value  of  problem  (I—)  at  a 

F-(oi)  E {x  c x|(x,y)  e F(a)}  (2.5) 

A-  E {a  e A|F-(a)  y 0}  . 

Notice  that  v^(a)  ^v(a),  F— (a)  CF(a),  and  A— c A. 

The  expression  int(A)  denotes  the  interior  of  A relative  to  E . 

If  a e int(A)  then  there  is  a neighborhood  N(a),  open  set  in  E con- 
taining a,  such  that  N(a)  ^ A.  The  relation  o c int(A^)  means  that 
there  is  a neighborhood  about  a in  which  y remains  feasible.  The  ex- 
pression btl(A)  denotes  the  boundary  of  A,  i.e.,  the  closure  of  A,  de- 
noted cl(’.),  less  int(A). 

The  set  A will  be  said  to  be  of  full  dimension  if  it  has  a non- 
empty  interior  relative  to  E . One  would  expect  that  in  most  instances 
A is  full-dimensional  since  it  is  dictated  only  by  feasibility.  But 
suppose  the  analyst  must  impose  certain  "specification"  constraints  on 
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his  selection  of  values  for  the  data  a.  Such  constraints  involving 
only  a (and  not  x or  y)  naturally  do  not  appear  in  problem  (I)  and 
therefore  do  not  Influence  the  set  A.  For  exan^le,  suppose  that  a con- 
straint characterizing  B(a)  is 


»1«1  - <-2«2  i 1 


where  the  euialyst  selected  values  for  and  such  that  = 1. 

If  it  is  imperative  that  these  data  sum  to  one,  then  we  should  be  cog- 
nizant of  that  fact  when  studying  the  continuity  of  v with  respect  to 
a.  Specifically,  we  need  only  to  address  continuity  relative  to  the 
subset  of  A for  which  “ 1-  Only  this  subset  is  "of  interest" 

to  the  analyst. 

We  shall  let  A denote  the  set  of  values  for  a that  are  of  interest 
to  the  analyst.  To  distinguish  between  all  data  and  data  "of  interest," 
the  elements  of  A will  be  referred  to  as  parameters.  Typically,  the 
analyst  is  interested  only  in  values  of  a in  proximity  to  a nominal 
point  a and  which  satisfy  the  specifications  for  selecting  the  param- 
eters a.  Additionally,  A may  be  restricted  by  a dependence  of  a on 
auxiliary  parameters  6:  a = a (6)  where  it  is  assumed,  of  course,  that 
a(-)  is  continuous.  For  exan^jle,  consider  the  function  (i.e.,  either 
an  objective  or  constradnt  function) 


“l^l  ^ “2*2 


where  a^  = 6 and  a^  = 6 . “x  “2  ^ treated  as  individual 

parameters  (alternatively,  a^^  euid  a^  can  be  replaced  by  the  single 


parameter  6)  then  A is  restricted  by  the  condition  that  a^  = 
the  other  hand,  the  relation  between  a^  and  might  be  fuzzy  in  the 


On 
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sense  that  the  analyst  is  willing  to  entertain  values  for  and 


given  by 


cij  ■ (1  ± and  ■ (1  i ’ 


In  this  case,  and  must  be  viewed  as  Individual  parameters  vvith  no 
restrictions  imposed  upon  them. 

What  this  discussion  leads  to  is  the  fact  that  we  weuit  to  address 
the  continuity  of  v relative  to  a subset  of  A (which  is  possibly  of 
smaller  dimension  than  A)  . To  this  end,  we  define 


A = A n A 
A = A DA. 

y y 


(2.6) 


These  sets  are  illustrated  in  two  dimensions  in  Figure  2.1, 


Figure  2.1.  The  Sets  A,  A,  and  A 


Definition  1:  v(-)  is  c- continuous  relative  to  A at  6i  e A if  for  emy 


Y > 0 there  exists  a neighborhood  N (a)  C e such  that 


a e A P N^(a)  |v(a)  - v(a)  ] < y + £ • 


v(*)  is  continuous  (i.e.,  0-continuous)  at  5 if  it  is  continuous  relative 


to  at  o;  v(*)  is  cx^ntlnuoai  on  a set  S if  it  is  continuous  relative 
to  S at  each  a e S. 

Lower  amd  upper  semi-continuity,  abbreviated  l.s.c.  amd  u.s.c., 
respectively,  are  weaker  tham  continuity.  In  this  paper  they  are  ap- 
plied only  to  functions. 


Definition  2;  A function  g(t)  is  l.s.c.  at  t if  for  y > 0 there  is  a 

neighborhood  N,(t)  such  that 
0 

t'  G N^(t)  g(t)  < g(t’)  + Y • 

g(-)  is  u.s.c.  if  -g(*)  is  l.s.c. 

We  will  see  that  v(*)  is  l.s.c.  under  very  mild  conditions. 

Another  kind  of  continuity  that:  v^ill  be  useful  Is  referred  to  as 
"directional"  continuity.  It  is  well-known  that  a function  can  be  dis- 
co2»tinuous  at  a point  even  though  it  is  continuous  along  all  lines 
through  the  point.  For  example,  the  function  given  as 


g(x,y) 


'0  if  y * 0 

x^/y  if  y ft  0 


is  continuous  along  all  lines  chrough  the  origin,  y = ax:  for  x 0, 

X 

g(x,ax)  = — ► 0 as  X -*■  0,  and  g(0,0)  = 0.  On  the  other  hand,  along  the 

cl 

2 2 

curves  y = x , we  have  g(x,x  ) = 1 for  x ft  0 , and  g(0,0)  = 0;  hence,  g 
is  not  continuous  at  (0,0). 

We  shall  say  that  this  function  is  directionally  continuous  al- 
though it  is  not  continuous. 


Definition  3:  A function  g(*)  is  continuous  in  direction  ^ at  t if  for 

any  y > ')  there  exisi;s  a 5 > 0 such  that 

O^0^6=^  |g(t  + 9U  - g(t)l^Y 
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where  t emd  ^ have  the  same  dimension. 

Of  course,  continuity  inplies  directional  continuity.  A case 
where  the  converse  holds  is  with  the  function 

v(b)  - min  f{x,y)  |G(x,y)  £b 

where  f and  G are  continuous  in  x for  fixed  y.  It  will  be  seen  in  the 
next  section  that  v(b)  is  not  necessarily  continuous  at  b,  but  if  it  is 
continuous  in  a certain  direction,  then  it  is  continuous. 

We  will  need  to  address  continuity  of  functions  of  the.  form 
g(a;x,y)  on  the  domain  A x X x Y.  But  each  element  y of  Y is  discrete 
so  continuity  on,  for  instance,  a x x x y makes  no  sense.  What  we  need 
is  continuity  of  g{";>,y)  as  a function  of  a and  x on  o x x for  y fixed. 
We  shall  use  the  "at"  symbol,  @,  as  follows. 

Definition  4;  "g  continuous  on  a x x @ y"  will  be  taken  to  mean  that 
g(*;*,y)  is  continuous  on  o x x for  y held  fixed;  g is  continuous  on 
a X X @ Y if  g is  continuous  on  a x x @ y for  each  y e Y. 

Actually,  we  wilx  address  continuity  on  a x F^(a)  rather  them  the 
larger  set  a x x.  Of  course,  y must  be  such  that  Fy(oi)  0. 

Definition  5;  y e Y is  feasible  at  a if  Fy(a)  / 0.  Thus,  y is  feasi- 
ble at  a if  there  is  em  x e X such  that  (x,y)  e B(a). 

Definition  6;  The  set  of  y's  feasible  at  a is  denoted  by  Y(a)  . Thus 

Y(a)  = {y  e Y I F^(a)  f 0]  . 

Analogously,  the  subset  of  X for  which  (x,y)  is  feasible  for  some 
y e Y is  given  by 

X(a)  = {x  e X I F (a)  0 for  some  y e Y}  . 

y 


39 


The  sets  X(a)  and  Y(a)  satisfy  X(a)  x Y(a)  “ F(o).  Notice  also 

that  X(a)  ■ U F (a) . 

Y y 

Finally,  we  will  need  the  concept  of  continuity  as  It  applies  to 

polnt-to-set  maps.  The  entitles  F(-),  B(*),  and  M (•)  which  we  have 

c 

alreewiy  defined  c2m  be  regarded  as  polnt-to-set  maps.  For  example,  F 
maps  a point  o Into  the  set  of  points  F(a)  ; thus  F:A  ->^  X x y.  Let  T 
denote  a general  map,  T:A  -►  Z where  A c and  Z r 

k 

Definition  7 ; The  map  T Is  open  (relative  to  A)  at  a e A If  {a  } c a, 

a -►a,  amd  z e T(a)  Imply  the  existence  of  am  Integer  m aind  a sequence 

k k k 

{z  }cz  such  that  z c T(a  ) for  k ^ m amd  z -+  z. 

k 

Definition  8;  The  map  T Is  closed  (relative  to  A)  at  a e A If  {a  } ci  A, 
k k k k 

a a,  z e T(a  ) , amd  z -►  z Imply  that  z e T(a)  . 

Definition  9;  T Is  continuous  (relative  to  A)  at  a e A If  It  Is  both 
open  and  closed  (relative  to  A)  at  a. 

*/ 

In  the  literature-'  the  terms  lower  and  upper  semlcontlnuous  used 
In  the  context  of  point-to-set  maps  have  meanings  similar  to  open  amd 
closed,  respectively.  In  fact,  for  the  spaces  which  we  shall  deal  with 
here,  these  similar  terms  are  equivalent.  We  choose,  therefore,  to  use 
the  terms  lower  amd  upper  semlcontlnuous  (l.s.c.  amd  u.s.c.)  only  as 
they  pertain  to  functions. 

A geometric  representation  of  open  and  closed  maps  is  perhaps 

easier  to  achieve  by  visualizing  the  sequence  of  sets  T(a  ) where 

k k 

a -►  a.  To  wit,  it  is  obvious  that  T is  open  at  a if  T(a)  c lim  T(a  ) 

auid  T is  closed  at  a if  T(a)  D lim  T(a  ) . It  follows  that  T is 

V 

-'For  instance:  Berge  [4];  Daintiig,  et  al.  [6];  Debreu  [8];  Evans  and 

Gould  [9];  Hogan  [16];  Meyer  [17];  Zangwill  [23,24]. 
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continuous  at  a if  T(a)  ■ 11m  T(a^)  . Conditions  which  are  necessary  as 
well  as  sufficient  are  stated  without  proof  as  follows: 

T is  open  at  o if  and  only  if  T(a)  c closure  [lim  T(a  )). 

T is  closed  at  a if  and  only  if  closure  [T(a)]  3 lim  T(a  ) . 

T is  continuous  at  a if  and  only  if  closure  [T(a)  ■» 
closure  (limT(o^)]. 

Figure  2.2(a)  depicts  a closed  map  that  is  not  open  and  Figure 
2.2(b)  eui  open  map  that  is  not  closed. 

Capital  letters  are  used  to  denote  maps,  sets,  and  vector-valued 
functions.  Scal2u:-valued  functions  and  points  are  denoted  by  lower 
case  letters.  Vector  inequalities  apply  to  each  conponent. 


CHAPTER  3 


FUNDAMENTAL  CONTINUITY  PROPERTIES  OF  NONLINEAR  PROBLEMS 

Conditions  are  derived  which  assure  that  v(*)  euid/or  M(*)  are  con- 
tinuous with  respect  to  the  data  a.  Certain  continuity  properties  of 
v(*)  and  M(*)  are  assured  by  similar  properties  of  the  objective  emd 
constraint  functions.  Stronger  continuity  results,  however,  depend  on 
an  "interiority  condition"  that  the  data  vector  a be  in  the  interior  of 
a certain  set  of  parameters.  A more  restrictive  condition,  referred  to 
as  "strong  feasibility"  by  Williams  [22],  is  also  studied. 

This  chapter  addresses  the  general  bounded  MIP  problem  defined  as 
problem  (2.1)  in  Chapter  2.  Application  to  the  linear  case  is  deferred 
to  Ch^^ter  6.  Thus,  we  will  address  the  optimal  value  function  given 
by 

v(a)  = minimum  f(a;x,y)  | (x,y)  c B(a)  (3.1) 

xeX,yeY 

where  X is  compact  and  Y is  a finite  set.  Other  point-to-set  maps  of 
interest  are  the  feasible  region,  F(a)  i B(a)  fl  (XxY)  , and  the  set  of 
solutions,  M^(a),  that  are  e-optimal  at  a (e  ^0). 

Not  all  data  may  be  of  concern  in  continuity  analysis;  only  certain 
data,  e.g.,  some  of  the  right-side  data  and/or  some  of  the  cost  data, 
are  usually  of  interest.  The  "interesting"  data  will  be  referred  to  as 
parameters. 

The  more  detailed  results  of  this  chapter  pertain  to  the  charac- 
terization of  B(a)  as  a collection  of  functional  constraints  on  the 
variables.  However,  several  statements  can  be  made  about  the  continu- 
ity of  v(*)  and  M(*)  with  regard  to  the  completely  general  domain, 

B(a).  Before  giving  a characterization  of  B(a)  (hence,  F(a))  we  offer 


..--;r:>^ 


the  following  has. ' conditions  for  continuity. 

3 . 1 Basic  Results  From  the  Theory  of  Point-to-Set  M/ips 

Theorem  3.1  is  taken  directly  from  Hogan  [16]  and  expressed  in  the 
context  of  problem  (3.1).  The  statements  of  this  theorem  are  fundaunen- 
tal  in  the  development  to  follow. 

Theorem  3. It  (a)  If  F(*)  is  closed  at  a e A,  if  there  exists  a neigh- 
borhood N of  a such  that  the  closure  of  U F(a)  is  compact,  emd  if  f is 
_ _ _ aeN  _ 

l.s.c.  on  a X X(a)  @ Y(a),  then  v(*)  is  l.s.c.  at  a. 

(b)  If  F(*)  is  open  at  a c A and  f is  u.s.c.  on  a x x(a)  0 Y(o),  then 
v(*)  is  u.s.c.  at  a. 

(c)  If  F(*)  IS  continuous  at  a c A and  f is  continuous  on  a x x(a)  0 
Y(a),  then  M^(*)  is  closed  at  a. 

Not  much  is  lost  in  the  strength  of  these  statements  if  the  domain 
a X x(a)  0 Y(o>  is  replaced  by  a x x 0 Y.  The  former  is  generally  not 
available  for  assessment  of  the  hypothesized  conditions;  besides,  in 
most  practical  mathematical  programming  problems  continuity  of  f holds 
over  the  entire  domain  a x x 0 Y.  The  next  four  theorems  obtain  eeisily 
from  Theorem  3.1. 

Theorem  3.2;  Given  that  a e A,  if 

(1)  f is  l.s.c.  on  a X x(a)  0 Y(o),  and 

(2)  is  closed  at  a for  each  y e Y(a)  (equivalently,  if 
F(*)  is  closed  at  a), 

then  v(*)  is  l.s.c.  at  a. 

Proof:  Since  Y is  finite,  F(*)  = U(F  (•)  xy)  is  a closed  map  if  each 

Y y 

Fy(*)  is  closed.  Furthermore,  F(*)  is  uniformly  bounded  since  X x y is 
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compact.  Thus,  f and  F satisfy  the  conditions  of  Theorer.)  3.1(a)  and 


I 


1 * 


the  result  obtains . | | 

If  problem  (2.1)  were  stated  as  a maximization  problem,  then  we 
must  replace  "l.s.c."  in  Theorem  3.2  by  "u.s.c.,"  and  vice  versa  in  the 
next  theorem. 

With  regard  only  to  continuity  of  v,  lower  semicontinuity  is,  in 
one  sense,  all  that  really  matters  to  the  (naive)  emalyst,  for  it  means 
that  small  perturbations  in  a cannot  cause  a discrete  improvement  in 
the  infimal  value  v.  (We  will  see  shortly  that  conditions  for  F(*)  to 
be  closed  are  very  mild  so  that  by  Theorem  3.2,  v is  l.s.c.  at  o also 
under  mild  conditions.)  On  the  other  hand,  it  would  be  shortsighted  to 
conclude  that  a continuity  analysis  can  be  limited  to  an  investigation 
of  lower  semicontinuity.  The  analyst  interested  in  varying  parameters 
must  be  concerned  with  any  discontinuity,  whether  it  causes  a discrete 
jump  \jp  or  a jump  down  in  the  infimal  value.  Moreover,  if  v is  l.s.c. 
at  a but  not  continuous , there  is  some  question  as  to  whether  the  model 
realistically  reflects  the  true  problem. 

Theorem  3.3;  Given  that  a e A,  if 

(1)  f is  u.s.c.  on  a X X(a)  @ Y(o),  and 

(2)  is  open  at  a for  each  y e Y (a)  (equivalently,  if  F(*) 
is  open  at  a) , 

then  v(*)  is  u.s.c.  at  a. 

Proof;  F(*)  is  open  since  the  union  of  an  arbitrary  family  of  open 
maps  is  open.  The  result  follows  since  F(*)  and  f satisfy  the  condi- 
tions of  Theorem  3.1(b).  || 

Combining  these  two  theorems,  we  have  the  following  continuity 
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result. 

Theorem  3.4;  Given  a e A,  if 

(1)  f is  continuous  on  a x x(a)  0 Y(a)i  and 

(2)  Fy(*)  is  continuous  at  a for  each  y e Y(a)  (equivalently, 
if  F(*)  is  continuous  at  a), 

then  v(')  is  continuous  at  a. 

The  conditions  of  Theorem  3.4  also  imply  that  the  map  M(*)»  which 
identifies  the  set  of  optimal  solutions,  is  closed  at  a.  This  follows 
from  Theorem  3.1(c). 

Theorem  3.5;  Given  a e A and  e ^ 0,  (1)  and  (2)  of  Theorem  3.4  imply 

M (•)  is  closed  at  a. 
c 

An  interesting  special  class  of  mixed  integer  progreuns  is  one  in 
which  all  parameters  appear  only  in  the  objective  function.  In  this 
case,  F(‘)  is  continuous  since  it  is  constant  with  respect  to  parcuneter 
changes.  By  Theorem  3.4,  v is  continuous  on  A provided  only  that  the 
objective  function  is  continuous  on  A x x 0 Y . 

To  be  more  general,  we  observe  that  v is  continuous  with  respect 
to  all  components  of  a which  appear  only  in  the  objective  function  if 
f is  contin;.,ou3  with  respect  to  a.  Going  one  step  further,  we  conjecture 
that  if  F(*)  is  continuous  with  respect  to  all  other  components  of  a, 
then  v is  continuous  at  a (i.e.,  with  respect  to  all  coirponents)  . That 
this  conjecture  is  indeed  valid  is  the  content  of  the  following  theorem. 

12  1 

Theorem  3.6;  Let  a = (a  ;a  ) where  a appears  only  in  the  objective 

function,  f,  which  is  assumed  to  be  continuous  on  a x x(a)  0 Y(o). 

— 2 — 

Then  v is  continuous  at  a if  v is  continuous  with  respect  to  a at  a. 
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Proof:  We  are  given  that  v is  continuous  with  respect  to  at  a and 

2 — 1-2 

with  res.oect  to  a at  a.  That  is,  v(a  ;a  ) is  continuous  as  a function 

1 — i — 1 2 2—2 

of  a at  o , and  v(a  ;a  ) is  continuous  as  a function  of  a at  a . First, 

we  note  thaf-.  f is  uniformly  continuous  with  respect  to  x @ y since 

X X y is  conpact.  That  is,  for  e > 0 there  exists  a 6^  > 0 such  that 

||a^-a^|  ^ I f (a^;a^;x,y)  - f(a;x,y)  | ^ j (3.2) 

— — 1—2 
for  any  x e X(a)  and  y e Y(a).  Secondly,  by  continuity  of  v(a  ;a  ), 

there  exists  a 6^  > 0 such  that 


a^-a^l  £ <5-  |v(a^;a^)  - v(a)  | ^ 


(3.3) 


—1  2 

Thirdly,  by  continuity  of  v(a  ;a  ),  there  exists  a 6 such  that 


|o‘^-a^|  ^ <5,  |v(a^;o^)  - v(a)  | <_  ^ 


(3.4) 


Define  6 « min (6j^,62 let  a be  a generic  point  satisfying 
|a-a|  £ 6 so  that  conditions  (3.2),  (3.3),  and  (3.4)  all  hold  at  a. 

Next,  observe  that  if  (x*,y*)  is  any  optimal  solution  point  at 

2 12 

(a  ;a  ),  then  (x*,y*)  is  feasible  at  (a  ;a  ) ' a so  that 


v(a)  ^ f(a;x*,y*) 

^ v(a'^;u  ) + y [by  (3.2)  ] 


(3.5) 


< v(o)  + e 


[by  (3.3)]  . 


^ . —12 
Similarly,  if  (x,y)  is  optimal  at  a,  then  it  is  feasible  at  (a  ,a  ) so 


-1  2,  ^ , -1  2 . 

v(a  ;a  ) < f(o  ;a  ;x,y) 


f(a;i,y)  + | [by  (3.2)] 
= v(a)  + . 


(3.6) 


Since  v(a)  - c/2  < v(a  ;a  ) by  (3,4),  we  have 
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III.,  I I'l'  ■ ■ - *'- 

v(a)  - e ^ v(a)  . 

Finally,  combining  (3.5)  and  (3.7), 

v(a)  - e £ v(a)  £ v(a)  + e 

which  establishes  continuity  of  v with  respect  to  a at  a. 


(3.7) 


Exanple  1;  The  economic  lot  size  model  with  N periods  and  equal  demand 
D in  each  period  c£ui  be  expressed  as 


N 

minimize  T.  "*■ 

k 

subject  to:  S X.  £ )cD, 

i=l  ^ 

0 _<  Xj^  < yj^  (WD)  , 
y^^  = 0 or  1, 


k = 1,2, ...  ,N 

k = 1,2, ...  ,N 
k = 1 ,2 , . . . ,N  . 


The  parameters  include  D,  and  the  Cj^  and  Sj^,  k = 1,2,...,N.  By  substi- 
tuting DZj^  for  Xj^,  we  obtain  an  equivalent  formulation: 


N 

minimize  Z [(c,  D)z,  + s,  y.  ] 

, , k k k k 

k=l 

k 

subject  to;  E z.  £ k,  k = 1,2,...,N 

i*l  ^ 

0 £ Zj^  £ Ny^^ , k=l,2,...,N 

yj^  = Oorl,  k = 1,2,... ,N  . 


We  observe  that  in  this  formulation  all  parameters  appear  only  in  the 

objective  function  and  we  conclude  that  v is  continuous  with  respect 

to  D , c,  , and  s,  , k = 1 , 2 , . . . ,N  (where  D > 0,  c,  > 0 , s,  > 0)  . 
k k — k — k — 

Example  2 : Let  a £ 0 and  c be  scalars  and  consider  the  hypothetical 


problem: 


max  y - cx 


subject  to:  (1  + a)  X y 

0 £ X ^ y 
y - 0 or  1 . 

The  infimal  value  v is  continuous  with  respect  to  c (i.e.,  as  a func- 
tion of  c alone)  since  c appears  only  in  the  objective  function.  The 
feasible  region  is  given  by 

F(a)  - {(0,0)  } U U/(l  + a),  1]  x (i) 

which  clearly  varies  continuously  with  respect  to  a (a  > 0)  . Hence,  by 
Theorem  3.4,  v is  continuous  with  respect  to  a (i.e.,  as  a function  of  a 
alone)  at  any  value  a > 0.  By  Theorem  3.6,  v is  (jointly)  continuous 
with  respect  to  c and  a (for  any  values  c and  a > 0)  . 

It  will  be  useful  to  recognize  that  there  are  two  )tinds  of  discon- 

jp 

tinuity  (relative  to  E ) that  can  arise:  those  caused  by  discontinuity 

of  F(*)  relative  to  A,  and  those  caused  by  bordering  infeasibility 
(a  e bd(A))  where  we  define  v(a)  = “>  for  a ^ A (for  minimization  prob- 
lems) . A point  of  discontinuity  a will  be  said  to  be  of  Category  I if 
v(*)  is  discontinuous  relative  to  A at  a.  A point  of  discontinuity  a 
will  be  said  to  be  of  Category  II  if  a e bd(A). 

A Category  I discontinuity  is  characterized  by  a finite  junp  in 
the  optimal  value  v.  In  the  capital  investment  example  problem  (1.1) 
of  Chapter  1 we  saw  that  a budget  of  b * (80,70)  yields  a value  v = 360, 
but  a budget  b^^  less  than  80  by  an  arbitrarily  small  amount  yields  a 
jump  down  in  optimal  value  to  v = 300.  The  point  b = (80,70)  is  clear- 
ly cm  interior  point  in  the  feasible  parameter  set  A;  therefore  it  is 
Category  I. 
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A Category  II  discontinuity  Is  characterized  by  nn  Infinite  jump 


t 

I 


since  |v| 


» for  a ^ A.  In  the  problem 


maximize  x 
X ^ 0 

subject  to:  X £ o 

we  have  A - 2md 


v(a) 


(a»  a ^ 0 

-<*>,  a < 0 . 


j 


I 


The  point  a ■ 0 is  a Category  II  discontinuity.  Notice  that  v is  con- 
tinuous on  A so  that  a - 0 is  not  of  Category  I.  In  fact,  in  any 
bounded  LP  problem,  a point  of  discontinuity  must  be  of  Category  II 
since  the  optimal  value  is  continuous  on  int(A)  (see  Chapter  6). 

The  following  observations  are  all  quite  obvious  and  eure  stated 
without  proof: 

(1)  Every  point  of  discontinuity  is  either  Category  I,  II,  or 
both. 

(2)  A point  of  discontinuity  a is  only  Category  I if  and  only  if 
a e int (A) . 

(3)  If  f is  finite  on  A x X x y,  then  every  point  on  bd(A)  cind 
only  these  points  are  Category  II  points  of  discontinuity. 

(4)  If  V is  finite  and  e-continuous  relative  to  E at  a,  then 
a e int (A) . 

Evidently,  to  investigate  the  continuity  of  v at  a point  a e A we 
must  consider  two  things:  the  continuity  of  v relative  to  A at  a,  and 

the  fact  that  a is  or  is  not  in  the  interior  of  A (relative  to  E ) . If 
A has  eui  interior  and  a is  contained  in  this  interior,  then  continuity 
and  relative  continuity  at  a are  equivalent.  If  a e bd(A)  , which 


i 


N 


:> 


( 
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includes  the  case  where  int(A)  ■ 0,  then  we  are  concerned  only  with  the 
particular  perturbations  of  a that  are  feasible  and  we  seek  to  determine 
if  a is  also  a Category  I point  of  discontinuity. 

Recall  that  the  parameters  a are  completely  general  (see  paragraph 

2 . 2 regarding  A emd  A)  and  may  be  viewed  as  continuous  functions  of 
auxiliary  parameters.  For  instance,  cost  coefficients  in  a capacity 
expansion  model  may  depend  on  discount  factors  that  in  turn  depend  on 
interest  rates  in  each  period.  If  a is  a continuous  (vector)  function 
of  other  parameters  6,  then  v is  continuous  with  respect  to  g if  v is 
continuous  with  respect  to  a. 

In  general,  we  are  interested  in  continuity  of  v relative  to  A or 
to  the  sets  A^.  Of  course,  continuity  of  v relative  to  A is  implied  if 
V is  continuous  relative  to  A.  Typically,  the  set  A is  easier  to  char- 
acterize than  A,  so  it  meikes  sense  to  first  investigate  continuity 
relative  to  A;  then  if  v proves  to  be  discontinuous  relative  to  A at  a 
we  will  want  to  determine  if  discontinuity  obtains  only  for  perturba- 
tional  changes  (directions)  from  a which  are  prohibited  by  the  require- 
ment that  a be  restricted  to  A. 

One  more  observation  worth  mentioning  regards  uniform  continuity 
and  boundedness  of  v.  If  the  set  A of  interesting  and  permissible 
values  for  a is  a compact  subset  of  A which  has  an  interior  relative  to 
E^,  then  v(*)  continuous  on  A in^lies  that  v(*)  is  uniformly  continuous 
and  bounded  on  A.  In  this  case,  continuity  on  A is  "smooth"  in  the 
sense  that  there  can  be  no  cusps  or  points  with  unbounded  slopes. 

3.2  Continuity  Conditions  on  the  Constraint  Functions 


The  set  B(oi)  is  described  here  in  terms  of  a collection  of  inequality 
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and  equality  constraints,  viz.: 

B(a)  - { (x,y)  |G(a;x,y)  0,  H(o;x,y)  =0}  (3.8) 

where  G:AxXxy->'E*''  and  HiAxXxy  + E^.  Thus,  G has  m component 

functions  g,  ,...,g  and  H has  n component  functions  h,,...,h  . The  dis- 
1 m in 

tinction  between  these  two  types  of  con;itraints  is  made  because  the 
conditions  on  G and  H which  assure  that  B(«)  is  closed  are  different. 

To  wit,  we  state  the  following  lemmas. 

Lemma  3.7;  P(a)  ^ {(x,y)|xeX,  yeY,  G(a;x,y)  ^ 0}  is  a closed  map  at  a 
if  each  con^ionent  function  of  G is  l.s.c.  on  a x x(a)  @ Y(a)  . 
k k k k k k 

Proof ; Given  a -*■  a,  (x  ,y  ) -►  (x,y)  , G(a  ;x  ,y  ) £ 0.  Let  e > 0 be 
an  arbitrary  m-vector.  By  lower  semicontinuity  of  G,  there  is  a 
such  that  k ^ implies 

k k k 

G(a;>:,y)  _<  G(a  ;x  ,y  ) + e <^  £ . 

Since  e is  arbitrary,  G(a?x,y)  £ 0 cind  P(*)  is  closed  at  a.  || 

Notice  that  since  Y is  finite,  y -*•  y requires  that  there  be  a 
such  that  y = y for  all  k ^ K^.  Notice  also  that  Gl.s.c.  on  ax  x@ 
Y(a)  is  equivalent  to  G l.s.c.  on  each  subset,  a x x @ y,  y e Y(a). 

Lemma  3.8;  Q(a)  = {(x,y)|xeX,  yeY,  H(a;x,y)  = 0}  is  a closed  map  at  a 
if  each  component  of  H is  continuous  on  a x x(a)  @ Y(a)  (i.e.,  continu- 
ous on  a X X @ y for  each  y feasible  at  a) . 

Prop f ! H and  -H  are  l.s.c.  on  a x x @ Y,  so  the  maps  Q (a)  H {(x,y)  | 
xeX,  ycY,  H(a;x,y)  _<  0}  and  Q^(a)  = {(x,y)|xEX,  yeY,  H(a;x,y)  ^0}  are 
closed  at  a by  Ler.ana  3.7.  Hence,  Q = Q 0 is  closed  at  a.  | | 

With  B(*)  given  by  ^’.8),  problem  (2.1)  appears  as  the  following: 


i 

1 


\ 

\ 
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Minimise  f(a;x,y) 
XEX,ytY 

s.t.  G(a;x,y)  £ 0 
H(a;x,y)  » 0 


(3.9) 


The  feasible  region  is  given  by 

F(a)  - P(a)n  Q(a)  * {(x,y)|xeX,  yeY,  G(a;x,y)  £0,  H(a;x,y)  - 0} 


It  is  important  to  recognize  that  problem  (3.9)  permits  the  generali- 
ties that  conponents  of  a can  be  interdependent  and  that  any  con^nent 
of  a cein  appear  in  several  or  all  of  the  objective  and  constraint  func- 
tions. Some  later  developments  will  demonstrate  how  improved  results 
Cein  be  obtained  by  sacrificing  generality  in  representation  of  the  data 


Theorem  3.9;  If  G is  l.s.c.  on  o x X(a)  0 Y(a)  and  H is  continuous  on 
a X x(a)  0 Y(a),  then  F(*)  is  closed  at  a. 

Proof;  F(*)  is  the  finite  intersection  of  closed  maps  (by  Lemmas  3.7 
and  3. S) . | | 

Theorem  3.10:  If  f is  l.s.c.,  G l.s.c.,  and  H continuous  on  a x x(a)  0 

Y(a)  then  v(«)  is  l.s.c.  at  a. 

Proof:  (If  a ^ A,  v(*)  = +».)  F(»)  is  closed  at  a by  Theorem  3.9,  and 


the  result  follows  from  Theorem  3.2. 


Theorem  3.10  states  that  v cannot  "juiip  down"  in  value  due  to  a 
"small"  change  in  a.  That  is,  for  any  e > 0 there  is  a neighborhood 
about  a such  that  the  infimal  value  at  any  point  in  this  neighborhood 
is  not  less  than  v(a)  - e. 

This  result  is  almost  intuitive  when  we  consider  that  F(*)  closed 
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at  a means  that  the  feasible  region  cannot  discretely  Increase  In  size 
when  a Is  only  slightly  perturbed.  In  particular,  this  asserts  that  a 
discrete  value  of  variable  y which  Is  Infeasible  at  a cannot  be  feasible 
at  any  point  arbitrarily  close  to  a.  This  observation  Is  formalized  as 
follows. 


Theorem  3.11;  If  F(*)  is  closed  at  a,  then  there  exists  a neighborhood 
N(a)  about  a such  that  Y(a)  cY(a)  for  all  a c N(a). 


Proof:  Notice  that  the  set  F (a)  is  closed  for  any  y.  Thus,  F (•) 

y y 

^ Ic  ““ 

closed  at  a means  that  11m  F (a  ) c F (a)  for  any  sequence  a a.  If 

y - y 

— ^ )c 

y is  Infeasible  at  a,  then  F^(o)  = 0 which  implies  that  F^(a  ) =0  for 

infinitely  many  k.  Thus,  there  exists  a neighborhood  about  a in  which 

y is  infeasible.  The  result  follows  since  Y is  a finite  set.  | | 


In  order  to  apply  Theorem  3.4  to  establish  continuity  of  v,  we 
would  like  to  determine  conditions  under  which  F(*)  is  open.  Unfortu- 
nately, these  conditions  are  more  severe  and  more  difficult  to  obtain 
than  those  for  closedness  of  F(*).  Furthermore,  F(*)  open  is  not  neces- 
sary. For  cases  where  F(*)  is  not  open,  we  are  interested  in  knowing 
what  conditions  in  addition  to  interiority  are  sufficient  for  v(*)  to 
be  continuous.  This  is  the  topic  of  Chapter  4. 


3. 3 Directional  Continuity 

Oftentimes  it  is  reasonable  to  consider  only  "directional"  chcinges 
in  the  data;  this  can  make  the  emalysis  of  continuity  a much  simpler 
task.  The  term  directional  is  used  rather  loosely  to  designate  data 
chcuiges  that  are  restricted  in  some  way.  For  instance:  increases  in 

objective  function  data,  all  other  data  held  fixed;  increases  in  right- 
side  data,  all  other  data  fixed;  or  changes  in  right-side  data 
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satisfying  b -f  6r  where  6 is  a scalar. 


■■  ' in 


M' 


Consider  the  special  case  a ■>  (c,a,b)  where  the  objective  function 
f depends  only  on  c,  G depends  only  on  a,  b denotes  right -ride  data,  and 
c,  a,  and  b are  independent.  This  special  case  of  problem  (3.9)  is 
expressed  as 


minimize  f(c;x,y) 
xeX,yeY 

subject  to:  G(a;x,y)  ^ b . 


(3.10) 


Equality  constraints  could  be  included  in  tills  problem  provided  they 
are  assumed  independent  of  a,  b,  amd  c (i.e.  , H(x.y)  * 0). 

One  continuity  property  of  problem  (3.10)  is  inmediate:  as  a 

function  of  c alone,  v is  continuous  for  all  values  of  c.  As  a special 
case,  tlia  optimal  value  function 

v^(0)  = minimum  f^;+8p;x,y)  | (x,y)  e F 

is  continuous  on  E (the  real  line). 

For  ease  of  exposition,  defii  e 

v(b)  = v(a,b,c) , a and  c fixed 

v(a,b)  H v(a,b,c) , c fixed 

v(c)  = v(a,b,c),  a and  b fixed  . 

As  before,  A -•  A n A where  A i { (a,b)  | (3.10)  is  feasible}  aind  A denotes 
any  specification  constraints  on  a and  b. 

Given  that  f is  continuous  on  (a,b,c)  x X @ Y,  it  follows  by 
Theorem  3.6  that  v(a,b,c)  is  continuous  at  (a,b,c)  if  v(a,b)  is  contin- 
uous at  (a,b)  . We  will  show  that  if  there  exists  a direction  r < 0 
along  vdiich  v(b)  is  oontii  uous  (at  b) , then  v(a,b)  is  continuous  at 
(a,b)  provided  that  G is  contii:”‘~uS  on  a x x 0 Y. 


j 

I 


i 
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This  proposition  is  fairly  intuitive:  if  b is  perturbed  in  any 

way  that  increases  the  feasible  region,  then  v(b)  cemnot  increase  in 
vedue  emd  by  Iheorem  3.10  it  cannot  jump  down  In  value.  Continuity  in 
a direction  r < 0 therefore  assures  that  v(b)  is  continuous  at  b.  Let 
"a"  denote  a (small)  perturbation  of  a.  If  (x,y)  is  feasible  at  (a,b) , 
then  by  continuity  of  G there  is  a "b"  close  to  b such  that  (x,y)  is 
feasible  at  (a,b)  . Continuity  of  v(b)  therefore  implies  continuity  of 
v(a,b) . A detailed  proof  is  given  below. 

Define  the  function  of  a single  variable: 


v(0) 


'minimum  f(c,x,y) 
xeX,yeY 

subject  to:  G(a;x,y)  £ b + 6*r 


(3.12) 


where  0 is  a scalar  and  r is  am  arbitrarily  chosen  negative  vector; 
r < 0. 


Theorem  3.12;  If  f is  continuous  on  c x X @ Y and  G is  continuous  on 
a X X @ Y,  then  v(a,b,c)  is  continuous  at  (a,b,c)  if  and  only  if  \^(*) 
is  right-continuous  at  0. 

Proof ; (Necessity  is  obvious.)  v is  l.s.c.  at  0 by  Theorem  3.10;  that 
is,  given  c > 0 there  exists  a y > 0 such  that  v(0)  ^ v(0)  + e whenever 
jo]  Y*  Notice  that  for  9 0,  v(0)  ^v(O).  Hence,  -y  < 0 0 =>  <^(0) 

- c £ v(0)  v(0)  so  that  V is  left-continuous  at  0.  With  the  hypothe- 

sis, we  have  that  v is  continuous  at  0.  Thus,  for  e > 0 there  exists  a 
6 > 0 such  that  [ 0 1 <_  6 implies 

K(0)  - v(0)  I 1 e/2  . (3.13) 

We  will  show  next  that  v(b)  is  continuous  at  b.  By  (3.13)  and  monotonic- 
ity of  V,  we  may  write 
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0 ^ v('j)  - v(-6)  ■ v(L  ♦ '‘>»r)  - v(b  - 6*r)  < e 


(3.14) 


(Remember  that  r < 0.)  The  hypercube  [b  + 6*r,  b - 6*r]  defines  a 
neighborhood  2dx>ut  b such  for  any  b in  this  neighborhood,  i.e.,  for 


b + 6*r  < 6 < b - 6»r 


we  have  by  monotonicity  of  v(b)  that 


Similarly, 


so  that  by  (3.14)  , 


v(b  + (5*r)  > v(b)  > v(b  - 6*r) 


v(b  + 6*r)  > v(b)  > v(b  - 6*r) 


v(6)  - v(b)  < e . 


(3.15) 


This  establishes  continuity  of  v(b)  at  b.  We  next  establish  continuity 
of  v(a,b)  at  (a,b) . Since  v(a,b)  is  l.s.c.  at  (a,b)  by  Theorem  3.10, 


we  need  only  to  estciblish  that 


v(a,b)  < v(a,b)  + c 


(3.16) 


for  (a,b)  sufficiently  close  to  (a,b)  . Suppose  that  (x*,y*)  is  an  opti- 


mal solution  at  (a,b+6*r).  Then 


Define 


G(a;x*,y*)  < b + 6*r  < b . 


N(a)  = (a|G(a;x*,y*)  < G(a;x*,y*)  - 


N(b)  = (b  + ^*r,  <»)  . 


(3.17) 


l^-r}  (3.18) 


(3.19) 


Clearly,  N(a)  x N(b)  is  a neighborhood  of  (a,b)  . TaJte  (a,b)  e N(a)  x 


N(b).  Then  (x*,y*)  is  feasible  at  (a, 6)  since 
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[by  (3.18)1 


G(a;x*,y*)  < G(a;x*,y*)  - ^*r 


^ b + 


< b 


(by  (3.17)1 
[by  (3.19)1  . 


■nius,  for  ^u^y  (a,b)  e N(a)  x N(b), 


v(a,b)  ^ v(a,b  + 6*r) 
< v(a,b)  + c 


[by  feasibility  of  (x*,y*)l 
[by  (3.15)1  . 


Tliis  establishes  (3.16)  so  that  v(a,b)  is  continuous  at  (a,b)  . Also, 
v(c)  is  continuous  at  c by  Theorem  3.4  since  F(*)  is  independent  of  c. 
Finally,  v(a,b,c)  is  continuous  at  (a,b,c)  by  Theorem  3.6.  | 


The  conclusion  in  Theorem  3.12  may  be  stated  as:  v(a,b,c)  is  con- 

tinuous relative  to  A at  (a,b,c)  if  v(*)  is  right-continuous  relative 
to  A at  0.  This  results  by  simply  replacing  N(a)  x N(b)  by  A 0 [N(a)  x 
N(b)l  in  the  proof. 

The  practical  significance  of  this  result  stems  from  the  fact  that 
it  is  much  easier  to  observe  or  compute  that  v changes  continuously 
with  respect  to  decrementing  b than  it  is  to  determine  that  v is  con- 
tinuous with  respecc  to  all  parameters.  It  is  sufficient  in  problem 
(3.10)  to  determine  that  v does  or  does  not  change  (increase)  by  a 
"small"  amount  vdien  each  component  of  b is  decremented  by  a "small" 
amount . 
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CIIAPTKK  4 

INTERIORITY  CONDITIONS  FOR  CONTINUITY  IN  NONLINEAR  PROBLEMS 

The  condition  that  a point  lie  in  the  interior  of  its  domain  is 
referred  to  as  interiority.  Two  kinds  of  set  interiority  will  be  stud- 
ied: parameter  or  data  set  interiority  (i.e.  , a c int(A)),  and  feasi- 

ble region  interiority  (which  will  be  defined  as  "strong  feasibility")  . 
This  chapter  is  devoted  to  the  mathematical  expression  of  interiority 
conditions  and  derivation  of  additional  conditions  which  are  sufficient 
for  continuity  of  v(‘)  and/or  closedness  of 

It  is  especially  difficult  with  mixed  integer  progreuns  to  deter- 
mine "a  priori,"  i.e,,  by  emalysis  of  the  model  itself  (without  the  aid 
of  any  particular  solutions),  that  v(*)  is  continuous.  This  would  re- 
quire observing  that  the  problem  possesses  desirable  properties  for 
each  feasible  y e Y,  since  it  is  not  known  prior  to  solution  which 
value (s)  of  y is  optimal.  It  is  certainly  less  effort  to  study  the 
continuity  properties  of  a problem  when  y is  fixed  at  some  feasible 
value.  Assessment  of  problem  properties  via  inspection  of  the  optimal 
or  c-optimal  solutions  is  referred  to  as  "post-optimal  continuity  analy- 
sis." Post-optimal  analysis  usually  involves  assessment  of  continuity 
properties  only  at  an  optimal  solution  point. 

Once  again  we  will  be  addressing  problem  (3.9).  Thus, 

v(a)  2 minimum  f (o;x,y)  jG(a;x,y)  ^0,  H(a;x,y)  = 0 . 
xEX,yeY 

Some  of  the  following  results  address  continuity  on  the  subset  A^, 
y c Y,  cUid  are  therefore  most  applicable  as  a post-optimal  cinalysis 
where  y is  optimal  (or  e-optimal)  . But  is  should  be  recognized  that 
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these  statements  apply  to  a generic  subset  and  if  the  stated  condi- 
tions can  be  assessed  for  all  feasible  y e Y,  then  an  a priori  conclu- 
sion can  be  made . The  sets  A and  A may  be  read  in  place  of  A and  A , 

y y 

respectively,  in  the  material  to  follow. 

Before  giving  a counterpart  to  Theorem  3.10,  we  will  need  to  intro- 
duce some  additional  interlority  terms.  Illustrations  of  the  concepts 
defined  herewith  are  intended  to  cultivate  insight  into  geometric  inter- 
pretations of  subsequent  results. 


4.1  .Set  Interlority  Concepts  and  Definitions 

The  interior  of  a set  is  a relative  term;  it  must  be  used  with 

reference  to  a given  space  or  set.  The  entity  int(A)  was  defined  earli- 

er  to  be  the  interior  of  A relative  to  E , since  A is  defined  as  a set 
r 

in  E . ThuS/ 


int(A)  = - cKe’^  - A) 

(4.1) 

where  cl(*)  = closure  (•) 

(A,  Ay,  or  Ay  may  be  read  in  place  of  A)  . Another  set  operator  is  "ri, 
which  denotes  the  relative  interior.  The  relative  interior  of  a set  A 
is  the  set  of  all  points  a e A such  that  for  an / e > 0 there  is  a 
6-neighborhood,  6 ^ c,  given  by 


N^(a)  = {o'  e E^  I fa-o’  | < 6}  (4.2) 

1 2 

which  contains  at  least  two  points  a e A and  a c A for  which 
> 6.  Thus, 


ri  (A)  H {a  e A I for  any  e > 0 and  some  6 £ e 
3 a amd  a e A D N. (a)  5 ja  -a  | > 6 } . 


(4.3) 


A subset,  e.g.,  A , of  A will  be  said  to  be  of  the  same  dimension 

y 
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as  A if  there  is  eui  open  set  tl  in  E such  that  A P N c A . A se.'-  in  E 

- y 

is  of  full  dimension  if  it  has  the  same  dimension  as  E ; thus,  A is  of 
full  dimension  if  it  has  a nonempty  interior  (this  definition  was  given 
earlier) . 

The  terms  "int,"  "cl,"  "ri,"  emd  "scune  dimension"  defined  in  the 
context  of  convex  sets  are  used  by  Rockafellar  [19].  The  sets  A,  A,  A^, 
and  Ay,  however,  are  not  necessarily  convex,  even  for  linear  MIP  prob- 
lems. 

Example;  Consider  a problem  with  two  parcunecers  (i.e.,  r = 2)  and  sup- 
pose that  A = [0,1]  X [0,1]  and  = [0,1]  x {1/2}.  These  sets  are 
depicted  in  Figure  4.1(a).  We  have 

int(A)  - (0,1)  X (0,1) 
int  (Ay)  = J3 
ri(A)  = (0,1)  X (0,1) 
ri(Ay)  = (0,1)  X {1/2}  . 

If  Ay  were  given  as  [0,1]  x [0,1/2]  as  shown  in  Figure  4.1(b),  then  we 
have 

int(A  ) = (0,1)  X (0,1/2) 

y 

ri(A  ) = (0,1)  X (0,1/2)  . 

y 

If  the  dimension  of  parameter  space  were  given  as  r = 3,  then  int  (A)  = 


int  (A  ) = 0 but  ri  (A)  and  ri  (A  ) remain  as  given  cibove  (in  both  situa- 

y y 

tions  cited) . 
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a 
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where  N(a)  is  an  arbitrary  (open)  neighborhood  about  a.  It  should  be 


Ai 

I 


z 


clear  that 


^int(A  ) , if  A 2uid  A are  of  full  dimension 

' y y 


^ t(Ay|A)  - I 


ri  (A  ) , if  A 2uid  A are  of  the  same  dimension  (4.6) 

y y 


if  A is  not  of  the  same  dimension  as  A . 

y 


Finally,  the  set  that  we  shall  employ  is  slightly  larger  them  int(Ay|A) 
in  that  it  includes  the  common  boundary  points  of  A^  emd  A.  For  this 
reason,  we  shall  call  this  set  the  oseudo-interior  of  A relative  to  A; 

y 


it  is  defined  (quite  sinply)  as 


pi(Ay|A)  = {a  e Ay  I 3 N(a)  9 A Pi  N(a)  C A^  . (4.7) 

- 3 

Exangale;  Suppose  A is  a closed  planar  disc  in  E emd  that  A^  is  half 
of  the  disc  shown  by  the  shaded  region  in  Figure  4.2(a).  Thus,  int(A) 
int(Ay)  =»  0.  The  set  int(Ay|A)  is  the  open  half  disc  and  pi(Ay|A)  is 
the  open  half  disc  plur,  the  boundary  portion  of  A that  is  common  to  A^. 
These  sets  are  depicted  in  Figure  4.2(b). 


Figure  4.2.  Example  Interior  and  Pseudo-Interior  Sets 
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4.2  Par£Bi>eter  Set  Interiority 

We  are  now  eQ}le  to  give  fairly  tight  sufficiency  conditions  for 


continuity  of  v.  Once  again,  the  sets  A and  may  be  read  in  place  of 


A and  A^,  respectively,  in  all  of  the  following  statements. 


Theorem  4.1:  Let  y be  optimal  at  a in  problem  (3.9)  . If 


(a)  o e pi  (A-|  A)  , euid 


(b)  is  finite  2uid  u.s.c.  relative  to  A—  at  a 

y y 


then  V is  u.s.c.  relative  to  A at  a. 


Proof;  (a)  implies  that  there  is  a neighborhood  N (a)  such  that  y is 
' 6 


feasible  at  any  a e A D N,(o).  By  (b) , for  e > 0 there  exists  a 6 , 

6 


0 < 6 <6,  such  that  a e AON  .(a)  implies  that 

6-^ 


v^(a)  > vy(a)  ~ e > 


or 


V— (a)  < v(a)  + e 

y 


since  v^(a)  = v(a).  Also, 


v(a)  < v—(a) 

- y 


for  all  a c A N , (a)  since  y fixed  restricts  the  feasible  domain. 


Consequently,  for  all  a e A N (a)  , 

6*^ 


v(a)  < v(a)  + e 


so  that  v(*)  is  u.s.c.  relative  to  A at  a.  | 

Condition  (a)  means  that  y remains  feasible  at  all  acceptable 
values  of  a in  "close"  pixiximity  to  a,  that  is,  at  all  a e A or  A in 
some  (small)  neighborhood  of  a.  Thus,  Theorem  4.1  says  that  if  a can 
be  slightly  perturbed  in  any  acceptable  fashion  without  rendering  y 
infeasible  and  if  the  continuous-variable  subproblem  v^  is  continuous 
at  a,  then  v is  continuous  (relative  to  A)  at  a (since  v is  l.s.c.  by 
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Theorem  3.6) . 


t 


t 


The  interiority  condition  (a)  of  Theorem  4.1  is  not  always  neces- 
sary. This  is  shown  by  the  problem 


minimize  0 
yc{0,l} 

subject  to:  a - 1 < y < a 


The  feasible  parameter  sec  A •=  [0,2|.  Let  a ^ 1.  Both  y = 0 and  y >>  1 
are  optimal.  For  y * 0,  A^  = t0,lj  so  that  pilA^jA)  = [0,1).  For 
y = 1,  A^  = [1,2]  so  that  pKA^^jA)  = (1,2).  Thus,  a = 1 pi(A— |a)  for 
any  y that  is  optimal  at  a.  Yet,  v is  obviously  continuous  at  m = 1. 

Condition  (a)  could  be  replaced  by  the  stronger  condition  that 
a c int(A— |a).  Also,  (a)  could  be  replaced  by  the  still  stronger  con- 
dition that  a e irt(A— ),  which  is  meaningful  when  A—  is  of  full  dimen- 

y y 

sion.  (In  application,  it  seems  that  A—  is  more  li)tely  to  be  of  full 
dimension  than  not.)  The  conclusion  is  then  also  slightly  stronger: 

V IS  u.s.c.  relative  to  E at  a.  This  follows  since  a e int(A).  We 
will  refer  to  these  alternate  conditions  as  (a)'  and  (a)": 


a c inti A—  A) 

y' 

a c int  (A—)  . 

y 


(4.8) 


notice  that  int(A— ) c int(A— |a)  ''pi(A— |a)  so  that  (a)"  ^ (a)  ' ^ (a). 

y - y>  _ y I 

Combining  Theorems  3.10  and  4.1  we  obtain  a significant  and  general 
continuity  result. 

Theorem  4.2:  Let  f and  H be  continuous  and  G l.s.c.  on  a x F— (a)  @ y, 

y 

where  y is  optimal  at  a.  Then  (a)  and  (b)  imply  that  v is  continuous 
relative  to  A at  a;  (a)  ' cuid  (b)  imply  that  v is  continuous  at  a. 


It  may  seem  at  first  glance  that  the  interiority  conditions  are 
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too  nebulous  and  awkward  to  b«>  tractable  in  practicjal  appl  icat  iciici . 

On  the  contrary,  we  suggest  that  these  conditions  can  be  assessed  usu- 
ally without  excessive  difficulty  either  by  direct  characterization  of 
the  set  A—  or  by  an  analysis  of  the  prtblem  constraints  at  cin  optimal 
solution,  systematized  for  special  problem  classes. 

In  the  following  exan^le  we  apply  Theorem  4.2  to  derive  a simple 
but  significeint  test  for  continuity  in  the  capacitated  facility  location 
problem  with  nonlinear  costs. 


Exanple  (The  Capacitated  Facility  Location  Problem  with  Nonlinear  Costs) : 


n 

m 

n 

Minimize  Z 

L 

c . . (x.  . ) + 

E d.y. 

X ^ 0 i=l 

j=l 

n 

13  13 

i=l  " ^ 

subject  to: 

Z 

i=l 

m 

X.  . = D.  , 

13  3 

j * 1 12  f • 

. . ,m 

E 

3=1 

X.  . <■  S.y. 
ID  — 11 

9 i “ 1 f 2 f • 

• • f n 

^i 

= 0 or  1 , 

i - lr2,. 

. . ,n 

The  transportation  cost  from  facility  i to  demand  area  j,  is 

taken  to  be  a finite  and  convex  function  of  the  queintity  x^^  on  [0,0^]. 
The  vectors  D and  S denote  demand  eind  capacity,  respectively,  and  d the 
setup  costs.  Continuity  with  respect  to  c is  interpreted  to  mean  con- 
tinuity with  respect  to  ciny  parameters  involved  in  the  definitions  of 

2 

the  convex  functions,  c.  ,.  For  instance,  if  c . = a.  .x,  . + b.  ,x.  . 

i:  ID  ID  ID  i:  ID 

(where  ^ 0)  then  v continuous  with  respect  to  c means  that  v is 

continuous  with  resnect  to  all  parameters  a.  . and  b.  .. 

ID  ID 

We  shall  address  only  the  parameters  D and  S since  by  Theorem  3.6 
and  Theorem  3.4,  v is  continuous  with  respect  to  all  parameters. 


J 
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(c,d,D,S)  , if  V is  continuous  with  respect  to  D and  S.  There  is  a 

feasible  solution  for  any  values  of  D euid  S satisfying  D ^ 0 and 

E D.  £ E S,.  Evidently, 
j ^ i ^ 

A = {(D,S) |d  ^ 0,  E Dj  ^ E S^}  (4.10) 

and  when  y is  held  fixed  at  y,  we  have 

A-  = {(D,S)|d  > 0,  E D.  < E S.y.}  . (4.11) 

y ' — 3—11 

It  is  immediately  apparent  that  (D,S)  is  in  the  set  pi(A— |a)  if  total 
demand  is  strictly  less  than  total  capacity;  that  is 


pi(A-lA)  = {(D,S)|d  > 0,  E D.  < E S.y.}  . 
y'  ' — ] 11 


(4.12) 


(It  happens  that  in  this  example  A and  A—  are  of  full  dimension  so  that 
int(A— ) = int(A— |a)  = {(D,S)|d  > 0,  E < E S^y^},  but  this  fact  is 
inconsequential  to  the  way  in  which  pi(A— |a)  is  determined;  it  is  only 
necessary  to  observe  that  A and  A—  have  the  same  dimension)  . 

When  y is  held  fixed  at  y the  resulting  subproblem  is  a convex 
progrcim  (in  the  continuous  variables  x)  with  linear  constraints  if  each 
c.  .(•)  is  convex.  Also,  the  set  A—  given  by  (4.11)  and  the  set  X - 

1]  y 

{x  E E™^|x  ^ 0}  are  then  clearly  convex.  It  follows  from  Theorem  2, 
Geoffrion  (llJ,  that  v—  is  convex  on  A—.  Consequently,  v—  is  continuous 

y y y 

on  int(A— ),  i.e.  , v—  is  continuous  at  any  (D,S)  satisfying  D > 0 cUid 

y y 

E D.  < E S.y..  Thesi'  conditions,  therefore,  imply  both  conditions  (a) 

j D i ^ ^ 

and  (b)  of  Theorem  4.2. 

We  may  now  state  the  following  continuity  result  from  Theorem  4.2 

for  problem  (4.9)  with  (c,d,D,S)  = (c,d,D,S): 

__  _ m_n _ 

If  D and  S satisfy  D > 0 and  E D.  < E S.y.  where  y is  optimal 

j=l  ^ i=l  ^ ^ 

a<-  (c,d,D,S)  , then  v(c,d,D,S)  is  continuous  at  (c,d,D,S). 
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I 


L 


1 

I 


It  is  also  clear  that  v is  continuous  at  (c,d,D,S)  where  S is  any 

vector  of  capacities  satisfying  the  following: 

m _ _ _ 

E x,.<S.  <S.,  i'‘y.=l 

j_l  O 1-1 

0<S.  <S.,  i^y.  *0 

— 1 — 1 1 

where  (x,y)  are  optim.  j at  (c,d,D,S).  This  follows  since  such  values 
for  S tend  to  shrink  tlie  feasible  region,  thereby  requiring  that  v(a)  ^ 
v(a) ; yet  (x,y)  remain  feasible,  hence,  optimal. 

It  is  tempting  to  conjecture  that  v remains  continuous  for  in- 
creases in  D and  decreases  in  S so  long  as  total  supply  at  y exceeds 
total  demand  (i.e.,  that  v is  continuous  at  (c,d,D,S)  where  D ^ D, 

S ^ S and  I < E Unfortunately,  this  conjecture  is  false;  the 

variables  y may  not  be  optimal  at  such  perturbed  values  for  D,S  and  it 
is  possible  that  v can  be  discontinuous  at  (c,d,D,S)  . 

If  we  allowed  the  case  where  D ^ 0 in  the  above  statement,  then  we 
could  conclude  only  that  v is  continuous  relative  to  A.  However,  it  is 

obvious  that  any  demcuid  node  for  which  D.  = 0 can  be  eliminated  from 

] 

the  network,  so  we  may  as  well  assume  that  ■ 0 for  all  j.  Tliereforo, 
to  determine  continuity  of  v,  we  need  only  to  observe  whether  at  y the 
total  capacity  exceeds  total  demand.  In  the  uncapacitated  problem 
continuity  obtains  provided  that  D > 0.  The  result  extends  easily  to 
the  problem  with  both  minimum  and  maximum  capacity  constraints. 

As  a numerical  illustration,  consider  the  following  problem  with  3 
potential  facilities  and  5 demand  areas: 


OH 


3 5 

_ 3 

Z Z 

X,  . 

+ 

d Z 

y . 

i=l  j=l 

ID 

i=l 

1 

X,  , + 

+ 
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4.2 
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21 

31 

X,  _ + 

x„_ 

+ 

X _ „ = 

4.6 

12 

22 

32 

X,  , + 

X „ , 

+ 

x_  = 

3.6 

13 

23 

33 

X,  . + 

x„ , 

+ 

X,  . = 

3.3 

14 

24 

34 

X,  + 

x_. 

+ 

X , ^ = 

2.6 

15 

25 

35 

X,  , + 

X 

+ 

X + 

X . 

11 

12 

13 

14 

+ 

X „ 

+ 

X + 

x„ , 

21 

22 

23 

24 

X + 

X _ 

+ 

X + 

X . 

31 

32 

33 

34 

X.  . > 

0,  ■ 

V.  ■ 

= 0 ( 

or  1 

13  - 

ID 

c < 9.5v 
15  - ^1 


'25  i ^•^'’2 


>35  l^.Syj 


(<1.13) 


- 1,^,3, 4, 5 


where  c and  d are  any  positive  scalars.  By  inspection  we  see  that  at 
least  two  facilities  must  be  opened;  since  all  arc  costs  are  equal  it 
would  not  be  optimal  to  open  all  three  facilities.  Thus,  y = (1,1,0), 
(1,0,1),  and  (0,1,1)  are  all  optimal.  Let  us  loo)c  at  y = (1,0,1). 
Then,  = 4.2,  x^^  = ^33  " ^34  “ ’'35  “ 

other  x-variables  are  zero.  Thus, 

5 _ 

T.  x^^  = 4.2  + 4.6  = 8.8  < 9.5y^ 


;;  X - 0 - 9.5y^ 
]=1 


J=1 


x = 3.6  •»-  3.3  + 2.6  = 9.5  = 9.5y, 
3 1 3 


so  tliat  the  third  capacity  constraint  (as  well  as  the  demand  constraints) 
is  binding.  Yet,  v is  continuous  since  I D.  = 18.3  < 19  = Z S.y,.  In- 
tuitively,  v is  continuous  since  any  small  change  in  D or  S can  be  ab- 
sorbed by  the  nonbinding  capacity  constraint (s)  . 
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Specializing  a conment  made  earlier,  it  is  clear  that  v is  also 


continuous  when  is  allowed  to  take  any  value  in  the  interval  (8.8, 
9.5]  and  is  allowed  any  value  in  [0,9.5].  That  is,  v is  continuous 
at  (c,d,D,S)  wht?re  D=  (4. 2 ,4. 6,  3 .6, 3. 3, 2. 6)  , e (8. 8, 9. 5],  e 

[0,9.5] , and  = 9.5. 

We  learn  from  this  example  the  significance  of  Theorem  4.2  when 
applied  to  entire  classes  of  problems.  Theorem  4.2  is  no  less  effective 
when  applied  to  a specific  problem  at  hand,  but  we  are  less  dismayed 
with  a tedious  determination  of  pi(A— |a)  if  the  consequent  continuity 
result  applies  in  general  to  a class  of  problems,  for  such  a result  is 
then  useful  when  applied  to  perturbations  and/or  modifications  to  the 
current  problem. 

Reference  to  the  continuous-variable  subproblems  of  problem  (3.9) 
and  continuity  of  v^  does  not  rule  out  the  pure  integer  case.  In  a pure 
integer  problem,  v^  is  constant,  hence  continuous.  Of  course,  if  all 
the  data  are  constrained  to  be  integral  as  well,  then  the  question  of 
continuity  is  not  pertinent.  The  class  of  pure  integer  problems  (with 
some  or  all  of  its  data  nonir.’-egral ) poses  a special  case  of  the  problem 
class  addressed  in  the  following  corollary  to  Theorem  4.2. 


Corol  J ar  y 4 . 2 . 1_:  Let  the  objective  function  in  problem  (3.9)  have  the 
form  f ( Suppose  f and  H are  continuous  and  G l.s.c.  on  n ^ 

y where  y is  optimal  at  u.  Then  v is  continuous  relative  to  A at  a if 
( t pi  (A  I A)  ; V is  continuous  at  a if  a c int(A— ). 

y ' y 

Proof : Wlion  y is  fixed  at  y,  f(a;y)  is  a constant,  hence  v—  is  continu- 
ous. I I 

A aeneral  result  that  is  computationally  more  practical  is  obtained 
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by  extending  Theorem  4.2  to  c-optimal  solutions  and  e-continuous  sub- 


problems. 


Theorem  4.3;  Let  y be  Cj^-optimal  at  a 2Uid  let  f and  H be  continuous  and 


G l.s.c.  on  a X F (a)  @ y.  Suppose  also  that  v—  is  finite  and  e^-contin- 
y y 2 


uous  relative  to  A—  at  o.  T^ien  v is  (Cj^+e^) “continuous  relative  to  A at 


a if  a e pi  (A— A)  ; v is  (e  +e_) -continuous  at  a if  a e int(A— ). 

y'  1 2 y 


Proof ; By  Theorem  3.10,  v is  l.s.c.  at  a so  that  for  y > 0 there  exists 


a i5  > 0 such  that  a e A P N.  (a)  implies 
^ ^1 


v{a)  - Y < v(a)  . 


(4.14) 


The  interiority  condition  means  that  there  exists  a 6^  > 0 such  that 


a e A P N-  (a)  implies 
^2 


v(a)  ^ “ • 


(4.15) 


V—  E -continuous  at  a means  that  for  y ^ 0 there  exists  a 6 > 0 such 

y ^ 3 


that  a E A P (a)  implies 


V— (a)  < V— (a)  + E_  + Y • 
y - y 2 ' 


(4.16) 


By  e^-optimality  of  y,  we  have 


v-(a)  < v(a)  + E,  . 
y - 1 


(4.17) 


Let  6 = min(<5^,62,62^  ' applying  (4.14)  through  (4.17)  in  succession, 


we  have  that  for  any  a e A P H (a)  , 


v(a)  - Y 1 v(a)  + e^  + + Y 


which  meems  that  v is  (c j^+E2)~continuous  relative  to  A at  a.  (Hence, 


only  a Category  II  discontinuity  could  occur  at  a.)  If  a e int(A— ), 


then  A—  and  A are  of  full  dimension  and  it  follows  that  A P N.  (a)  = 
y 6 


tJ,  (a)  s(<  that  V is  continuous  relative  to  E at  a. 
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IfTWJTTS! 


Theorems  4.1,  4.2,  and  4.3  presuppose  that  an  optimal  solution 
vector  y is  availcible.  For  some  problem  classes  it  is  apparent  that 
is  continuous  for  all  y e Y(a).  In  this  case,  an  "a  priori"  conclusion 
can  be  made;  i.e.,  we  may  conclude  (subject  to  interiority)  that  v is  con- 
tinuous without  knowledge  of  an  optimal  solution.  This  observation  is 
stated  as  follows: 

Corollary  4.3.1:  Let  f and  H be  continuous  euid  G l.s.c.  on  a x X 0 

Y(a).  If  Vy  is  e-continuous  for  each  y e Y(a)  and  a e pi(A^|A)  for 
each  y e Y(a),  then  v is  c-oontinuous  relative  to  A at  a. 

A similar  consequence  of  Theorem  4.3  addresses  continuity  on  an 

open  subset  of  A.  Define  Y(N)  J Y(a),  where  N is  an  open  subset  of 

acN 

A. 

Corollary  4.3.2:  Let  N be  an  open  subset  of  A.  Let  f and  H be  continu- 

ous euid  G l.s.c.  on  N x x 0 Y(N).  If  each  y which  is  feasible  for  some 
a e N is  feasible  for  all  a e N (i.e.,  if  y e Y(N)  y e Y(a),  a e N) 
and  if  v is  e-continuous  on  N,  then  v is  e-continuous  on  N. 

y 

Proof : y feasible  at  each  a e N implies  that  N ^ A^.  Thus,  for  any 

a e N and  y e Y(a) , we  have  a e int(A  ) and  v e-continuous  at  a so 

y y 

that  V is  e-continuous  at  a by  Corollary  4.3.1.  Consequently,  v is 
e-continuous  relative  to  E on  N (since  N is  open) . 

Example  (The  Dynamic  Lot-Size  Model  with  Nonlinear  Costs) : Wagner  [20 ] , 

p.  303,  discusses  the  dynamic  lot-size  model  with  concave  costs.  An 
MIP  formulation  of  tliis  problem  where  the  production  and  holding  costs 
are  permitted  to  be  any  continuous  functions  of  the  amounts  produced  is 
given  as  follows: 
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Minimize  E c.(x.)  + d.y.) 
^ « •,  11  11 
X > 0 1-1 


subject  to:  I X.  ^ E D,  , i 

j-1  ^ j=l  ^ 


X.  < My.  , i 

1 — 1 


(4.18) 


y^  = 0 or  1 , i 


where  M is  a very  large  number.  It  will  be  shown  via  Corollary  4.3.2 

that  V is  continuous  on  A.  We  may  assume  that  > 0 foi  all  j since 

otherwise  the  model  could  be  reformulated  to  eliminate  all  periods  with 

Dj  = 0.  This  model  presumes  (without  loss  of  generality)  that  initial 

inventory  is  zero.  Consequently,  y^  - 1 in  any  feasible  solution  at 
n 

D t n (0,““)  - N.  That  is,  any  y that  is  feasible  for  some  D c N is 

j=l  n 

feasible  for  all  D c N,  for  one  could  always  take  x,  = E D,.  Second- 

1 j-1  3 

ly,  any  perturbation  in  D can  be  edjsorbed  by  x^^:  replace  x^  by  x^^  = x^ 

n 

+ E (Ad)  . where  6d  is  a perturbation  to  D.  The  corresponding  change 

j=l  ^ 

in  V is  no  more  than  | c^  (x^) -c^  (x^^)  1 which  is  small  if  6d  is  small  since 

c,  is  continuous.  Clearly,  v is  continuous  on  N.  We  conclude  via 

1 y 

Corollary  4.3.2  that  v is  continuous  with  respect  to  D on  N.  Finally, 
letting  C denote  the  set  of  acceptable  values  for  the  parameters  defin- 
ing the  ( • ) , and  observing  that  N is  also  a domain  for  the  setup  costs, 

d,  we  may  state  that  v(c,d,D)  is  continuous  on  int(C)  « N » N.  Tc  allow 
for  zero  setup  costs,  we  can  take 


A = c X II  [o,“>)  X n (o,“>)  . 

i=l  i=l 


Then  v for  problem  (4.18)  is  continuous  relative  to  A at  all  (c,d,D)  e 


73 


In  view  of  Theorem  4.3,  v;e  are  interested  in  specific  conditions 
for  special  problem  classes  which  assure  that  the  optimal  value  func- 
tion of  a continuous-variable  subproblem  is  continuous.  Such  conditions 
coiQ/Jed  with  interiority  then  imply  continaity  in  the  MIP  problem. 

4.3  Strong  Feasibility 

A concept  related  to  the  interiority  condition  on  a is  the  condi- 
tion that  there  be  a point  in  vari.'^ble  space  for  which  all  inequality 
constraints  are  nonbinding.  We  will  assume  in  this  subsection  that  H 
is  independent  of  a and  continuous  on  X @ Y. 

Definition;  y is  strongly  feasible  (s.f.)  at  a if  F— (a)  has  an  Interi- 
or relative  to  {x  c x|H(x,y)  = 0}.  Equivalently,  y is  s.f.  at  a if 
p-(a)  H {x  G x|H(x,y)  = 0,  G(a;x,y)  < 0}  ^ 0. 

Strong  feasibility  precludes  equality  constraints  that  involve  a. 
Equality  constraints  that  do  not  depend  on  a could  be  assumed  away  as 
well  since  by  the  Implicn,  Function  Theorem  the  problem  may  be  regarded 
as  one  with  fewer  variadiles  2uid  only  inequality  constraints  (provided 
that  H is  continuously  dif ferenticible  and  has  a nonsingular  Jacobian) . 

Leimna  4.4;  Let  G be  continuous  on  N(a)  x X @ y where  N(a)  is  any  open 
set  in  containing  u (II  = H(x,y)  is  continuous  on  X(a)  @ y)  . Then 
y s.  f . at  u > p (a)  / 0 f int(A  ). 

y y 

Proof ; The  equivalence  is  by  definition.  If  y is  s.f.  at  a,  then 
there  is  an  x c X such  that  G(a;x,y)  < 0.  Continuity  of  G with  respect 
to  a implies  the  existence  of  a neighborhood  N^(a)  such  that  G(a^;x,y) 

«"  0 for  all  e N^(nt).  Therefore,  N^(a)  a and  a c int(A  ).  I I 

- y y ' ' 


Strong  feasibility  is  a stronger  condition  than  parameter  set 


I 


interiority.  This  is  illustrated  by  the  facility  location  problem  dis- 
cussed earlier  (ex2uif>le  to  Theorem  4.2).  Any  y^  = 0 forces  = 0 so 

that  X cannot  be  in  the  interior  of  Fy(*)  for  amy  y with  a zero  compo- 
nent. The  condition  a e int(Ay),  however,  holds  under  mild  conditions 
on  the  parameters,  as  discussed  in  the  example. 

Although  strong  feasibility  is  a more  severe  condition,  in  some 
situations  it  may  be  more  readily  apparent  than  is  parameter  set  interi- 
ority. If  strong  feasibility  holds,  then  by  Lemma  4.4  there  is  no  need 

to  test  for  interiority  in  A^.  St;^pose  that  y is  Gj^-optimal  at  a in 

problem  (3.9).  If  it  is  known  that  v—  is  E_-continuous  relative  to  A— 

y 2 y 

at  a,  then  G(a;x,y)  < 0 for  some  x c F~(a)  implies  that  v is  (g^+e^)- 
continuous  at  a by  Theorem  4.3.  (Of  course,  a-interiority  may  hold  even 
when  equality  is  forced  in  some  or  all  of  the  components  of  G.) 

A special  case  in  which  strong  feasibility  and  parameter  set  inte- 
riority are  equivalent  (with  a qualification  as  in  Theorem  4.5  below) 
is  when  G has  the  form  G(a;x,y)  = G(x,y)  - a,  where  G,  G and  a have  the 
same  number  of  components.  But  we  shall  explore  a larger  class  of  func- 
tions for  which  these  two  conditions  are  equivalent.  Let  a = (a,b) 
where  b has  dimension  m and  a has  dimension  r-m.  Suppose  that  the  con- 
straints have  the  form 


G(a;x,y)  ^ b . 


(4.19) 


Let  denote  the  projection  of  A onto  b-space  v/ith  a = a;  i.e  ., 

y y 

(b  L G(a;x,y)  < b for  some  x e F (a)  ) . 

y ' - y 

Theorem  4.5:  If  G is  continuous  on  a x F (a)  § y and  must  satisfy 

y 

(4.19),  and  if  no  component  of  G satisfies  g^(a;x,y)  = b^  for  all  x g X, 


then  the  following  conditions  are  all  equivalent: 
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(a)  b e int(Ay) 

(b)  o c int(Ay) 

(c)  y s.f.  at  a . 

Proof  I CSjviously  (b)  (a).  (c)  (b)  by  Leima  4.4.  By  (a)  there 

exists  a b < b such  that  y is  feasible  at  b;  i.e.,  there  exists  ein 
X e Fy(a)  such  that  G(a;x,y)  ^ b < b.  Thus,  y is  s.f.  at  a so  that 
(a)  ‘-■>  (c)  . II 

Theorem  4.5  inplies  that  with  the  given  hypotheses,  if  v is  contin- 
uous with  respect  to  the  right-side  data  b,  then  v is  continuous  with 
respect  to  the  other  parauneters  a as  well  (provided  G is  continuous  as 
specified);  secondly,  for  this  class  of  problems,  a-interiority  and 
strong  feasibility  are  equivalent  conditions.. 

Constraints  of  the  form  (4.19)  are  stamdard  in  linear  MIP  problems 
and  are  typical  in  most  other  classes  of  mathematical  programming  prob- 
lems. It  was  shewn  in  paragraph  3.3  that  when  the  constraints  have 
this  form,  directional  continuity  of  v witli  respect  to  b implies  conti- 
nuity with  respect  to  a. 

The  two  types  of  interiority  conditions  that  we  have  addressed 
both  imply  that  y remains  feasible  for  small  perturbations  in  n.  We 
are  next  concerned  with  finding  conditions  which  imply  that  y,  optimal 
at  a,  remains  optimal  for  certain  small  perturbations  in  i,  for  this 
implies  continuity  of  v on  a set  rather  them  at  a point.  Introductory 
results  on  this  subject  are  given  in  the  next  two  theorems. 

Theorem  4.6:  Define  r(a)  {«  r a|f(ci)  C F(a)}.  Let  G be  continuous 

on  N(n)  * X (J  y where  y is  optim.il  at  « and  N(d)  is  cir.y  open  set  in 
containing  a.  I f y is  s . f . at  u , then  there  exists  a neighborhood 
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N^{o)  c N (a)  such  that  y is  optimal  on  N^(a)  ''  S(a). 

Proof;  There  exists  an  x e X such  that  G(a;x,y)  < 0 (H(x,y)  “0).  By 

continuity  of  G,  there  is  a neighborhood  N^(a)  c N(a)  such  that  a c 

N^(a)  G(a;x,y)  < 0.  Hence,  (x,y)  remains  feasible  on  N^(a)  so  that 
f independent  of  a implies  v(a)  ^ v(a)  for  all  a c N^(o).  Consequently, 
v(a)  = v(a)  on  N^(a)  H s(a)  so  that  y must  be  optimal  on  this  set.  | | 

Theorem  4.7;  Let  f be  continuous  on  a « X(a)  @ y where  y is  optimal  at 
a,  and  let  G be  continuous  on  N(a)  x x@y.  If  y is  s.f.  at  a,  then 
there  exists  a neighborhood  N^(a)  on  which  y is  e-optinal. 

Proof ; V is  l.s.c.  at  a by  Theorem  3.10;  hence,  there  is  a neighbor- 
hood N^^(a)  on  which  v(a)  < v(a)  + c.  By  Theorem  4.6  there  is  a N^(a) 

on  which  v(a)  ^ v(a)  (see  proof).  Let  “ N^^(a)  ^ (a)  . Then 

for  all  c!  c (a)  , y is  feasible  and 

v(a)  < v(a)  < v(a)  + e . 


It  follows  that  y is  e-optimal  on  N^(a) 
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CHAPTER  5 


CONTINUITY  PROPERTIES  OF  CONVEX  MIP  PROBLEMS 


An  MIP  problem  where  the  objective  function  cr  one  or  more  of  the 
constraint  functions  satisfies  some  type  of  convexity  (or  concavity)  is 
loosely  referred  to  here  as  a convex  problem.  The  optimal  value  func- 
tion V generally  will  not  be  convex  or  concave.  In  this  chapter  we  con- 
centrate on  the  particular  convexity  assumptions  that  assure  continuity 
of  V ( • ) . 

5 . 1 Convexity  Assumpt ions 

The  set  X is  assumed  to  be  convex  as  well  as  bounded.  Let  the  data 
be  represented  as  u = (c,a,b,d)  and  rewrite  problem  (3.9)  in  the  form 


Minimize  f(c;x,y) 

(x,y)cU 

subject  to:  C,(a;x,y)  < b 


(5.1) 


H(a;x,y)  = d 


where  U 2 ^ set  U is  employed  to  accommodate  constraints  in 

botli  X and  y that  do  not  involve  data  "of  interest." 

Problem  (5.1)  is  actually  no  less  general  than  problem  (3.9):  it 

is  not  required  that  c,  a,  b,  and  d be  independent  or  tliat  b and  d be 
something  otlier  than  zero-vectors  (ttiat  is,  prolilem  (3.9)  results  by 
settino  b and  d to  zero  and  replacing  c and  a by  i) . However,  it  will 
be  instructive  to  view  b euid  d as  ‘•.i;u»'ce  resources. 

As  before,  the  following  notation  will  be  used: 


v(c)  v(c,a,b,d)  where  a,b,d  are  fixed 


v(b,d)  v(c,a,b,d)  where  c,a  are  fixed 
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t 


Slmil2kr  definitions  hold  for  v (•)•  Define  also 

y 


Zy  H { (b,d) lF^(c,a,b,d)  ^ 0} 


(5.2) 


where  F^{c,a,b,d)  denotes  the  feasible  region  in  (5.1)  when  y,  c,  and  a 
are  held  fixed. 

Theorem  5.1:  Given  that  f and  G are  convex  and  H linear  in  x for  y and 

a fixed,  ^u^cl  that  f is  continuous  on  c « X @ Y and  G and  H are  continu- 
ous on  a X X <3  Y : 

(a)  Z is  a convex  set,  y e Y 

y 

(b)  Vy(b,d)  is  continuous  and  convex  on  Z^,  y c ^ 

(c)  V is  e-continxxDUS  at  a if  (b,d)  c int(Z^)  for  some  y that  is 

— */ 

E -optimal  at  a.—' 

Proof ; (a)  Let  (b^^,dj^)  , (b2»d2)  e y e Y.  By  definition,  there  exist 

Xj^,X2  e X such  that 

G(a;Xj^,y)  ^ b^  , G(a;X2»y)  ^ t>2 

H(a;Xj^,y)  = d^^  , H(a;X2,y)  = . 

We  see  that  (L,d)  X(b^,d^^)  + (l-\)(b2,d2)  e Z^,  where  A e (0,1), ■ this 

follows  since  x ' Xx^^  + (1-X)x2  satisfies: 


G(a;x,y)  ^ XG(a;x^,y)  (l-X)G(a;x_,iy) 
< Xb^  + (1-X)b2 


H(a;x,y)  = XH  (a; ,y)  + ( 1-X ) H (a  .-x^  ,y) 
= Xdj  + (1-X)d2 


V 


Result  (c)  holds  without  the  convexity  assumptions  on  f and  G. 
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(b)  v^(b,d)  is  l.s.c.  on  by  Theorem  3.10.  It  suffices  to  show  that 
V (b,d)  is  convex  on  Z (this  can  be  deduced  from  Geoffrion  [111,  Theo- 

y y 

rem  2,  but  we  present  the  proof  in  the  current  context).  Let  (b,d)  be 
defined  as  in  part  (a) . 


V (b,d)  » min  f(c;Xx  + (l-X)x  ,y) 

Xj^.X^CX 


G{a;Xx^  + (1-X)x2,y)  b 
H(a;Xx^  + (1-X)x2,y)  = d 


^ min  f(c;XXj^  + (l-Xjx^/y) 

Xj^  rX^t-X 


G(a;x^,y)  G(a;x2,y)  ^ b^ 

H(a;x^,y)  = , MCa.-x^/y)  = d^ 


^ min  Xf  (c;Xj^  ,y) +(1-X)  f (c.'X^.y) 

x^,X2CX 


G(a;Xj^,y)  Gia.-x^.y)  £ b^ 

H(a;Xj^,y)  = d^ , Hta.-x^/y)  = d^ 


Xv  (b  ,d  ) + (l-X)v  (b  ,d  ) . 
y 1 1 y 2 2 


(c)  Suppose  that  y is  c-optimal  at  a ^ (c,a,b,d)  and  that  (b,d)  c 
int(Z  ).  If  a c int (A-)  , then  the  desired  conclusion  is  immediate  from 

y y 

Theorem  4.3  rince  is  continuous  (convex,  in  fact).  By  hypothesis, 

there  exists  an  open  ball  N (b,d)  Z— . That  is,  for  any  (b,d)  such 

^ - y 

that  II  (b,d)  - (b,d)  II  < 6 there  exists  an  x c X such  that  G(a;x,y)  ^b  and 
H(a;x,y)  = d.  The  hypothesized  continuity  of  G and  H imply  the  exist- 
ence of  a neighborhood  N(a)  about  a such  that 


a c N(a) 


G(a;x,y)  - G(a;x,y) 
H(a;x,y)  - H(a,-x,y) 


< 6/2 


(5.3) 


where  6 is  independent  of  x and  y since  XxY  is  bounded.  Let  (a,b,d)  c 

N(a)  * N,_(b,d)  and  write  the  constraints 
6/2 


G(a;x,y)  • L,  H(a;x,y)  = d 


(5.4) 


in  the  1 orm 


w 


(5.5) 


G(a;x,y)  _<  6 = b + G(a;x,y)  - G(a;x,y) 
H(e«x,y)  - ^ = d + H(a;x,y)  - H(a;x,y)  . 


Now  (b,3)  e N,(b,d)  since,  using  (5.3)  emd  the  fact  that  (b,d)  e 
d 

N - (b  #<i)  t 
6/2 


b 

d 


• 1(3 

+ 

G(a;x,y)  - G(a;x,y)'| 

- 

H(a;x,y)  - H(a;x,y)J 

G(a;x,y)  - G(a;x,y) 

III  d-d j 

II 

H(a;x,y)  - H(a;x,y) 

< 6/2  +6/2=6. 


This  means  there  exists  2m  x'  c X satisfying  (5.5),  hence  (5.4);  there- 
fore N(a)  X N-,_(b,d)  is  contained  in  the  set  of  feasible  values  for 

it/ 1 

(a,b,d)  and  consequently  v is  continuous  with  respect  to  (a,b,d)  by 
Theorem  4.3.  It  follows  from  Theorem  3.6  that  v is  continuous  with 
respect  to  a h (c,a,b,d)  . (Notice  that  result  (c)  holds  without  the 
convexity  assumptions  on  f and  G — only  continuity  is  needed.)  | | 

This  result  states  that  (under  the  hypotheses)  if  small  perturba- 
tions in  (b,d)  do  not  destroy  feasibility  when  y (optimal  at  o)  is  fixed, 
then  V is  continuous  at  a.  The  computational  leverage  that  this  result 
provides  in  a continuity  analysis  is  that  one  needs  only  to  address  the 
right-side  parameters  (b,d)  . Notice  that  conclusion  (c)  implies  that 
v(*)  is  discontinuous  at  a if  emd  only  if  v(b,d)  is  discontinuous  at 
(b,d) . 

With  regard  to  problem  (3.9)  wherein  the  right  sides  of  the  con- 
straints are  zero,  the  parameters  (b,d)  may  be  viewed  as  perturbations. 
Application  of  Theorem  5.1  then  states  that,  under  the  hypotheses,  v is 
continuous  not  only  with  respect  to  a but  also  with  resjject  to 
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perturbations  (L,d)  about  zero  to  the  right  side. 

The  interiority  condition  of  Theorem  5.1(c)  is  equivalent  to  strong 

* / 

feasibility  if  (b,d)  is  regarded  as  part  of  the  data  a (Theorem  4.5).— 
The  next  result  applies  to  problem  (3.9)  but  the  strong  feasibility 
hypothesis  can  be  replaced  by  the  interiority  condition  of  Theorem 
5.1(c)  in  the  context  of  problem  (5.1). 

Theorem  5.2:  Let  f eind  G be  continuous  on  a x X 0 Y.  Suppose  that  c; 

is  convex  in  x for  fixed  a and  y and  that  H is  not  dependent  on  ot.  Then 
the  existence  of  a y e Y that  is  optimal  £uid  strongly  feasible  at  a im- 
plies that  M (•)  is  closed  at  a. 
c 

Proof ; fy^*)  is  open  at  a by  Theorem  12,  Hogcin  [16];  hence,  F(*)  is 

open  at  a (since  F(*)  = U F (•)  and  an  arbitrary  union  of  open  maps  is 

yeY  ^ 

an  open  map  — see  Berge  [4]).  Also,  F(*)  is  closed  by  Theorem  3.9;  so 
F(*)  is  continuous  at  a emd  the  result  follows  from  Theorem  3.5.  II 


The  optimal  value  function  v is  the  pointwise  minimum  of  the  finite- 
ly many  functions  v : v(a)  = min  {v  (a) }.  Under  the  conditions  of 

^ _ yeY  ^ _ 

Theorem  5.1,  each  function  v^(b,d)  is  c:onv^'x  so  that  v(b,d)  is  piecewise 
convex.  Now,  in  order  for  v(-)  to  be  discontinuous  at  a point  a it  must 


be  that  (b,d)  is  such  that  each  y n becomes  infeasible  for  some 

arbitrarily  small  perturbation  in  (b,d).  That  is,  for  any  y e Mq(o), 
(b,d)  e bd(Z— ) . The  next  result  states  that  the  set  of  such  points  is 
relatively  small.  Define: 


*/ 

—If  (b.d)  is  not  part  of  the  data,  i.e., 
a 


= (c,a). 


c int(Ay)  where  y is  not  strongly  feasible  at  u. 


then  one  could  have 
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Wy  5 {(b,d)  I y is  optimal)  r 

D = {(b,d)  I v(b,d)  is  discontinuous  at  (b,d)  } 

u(D)  = (Lebesque)  measure  of  D relative  to  the  smallest  subspace 
containing  D. 

Theorem  5.3;  lJ(D)  =*  0.  (The  Scc  of  points  a at  which  v(*)  is  discon- 
tinuous has  relative  measure  zero) . 

Proof ; By  Theorem  5.1(c),  v(*)  is  discontinuous  at  a if  and  only  if 

v(b,d)  is  discontinuous  at  (b,d)  . I«t  t be  the  smallest  dimension  such 

that  D C and  let  T be  an  arbitrary  subset  of  with  finite  measure. 

Per  the  above  discussion,  U bd(//  ).  Since  u[cl(W  )]  = ;j[int(W  )] 

yey  y ^ ^ ^ 

where  the  interior  is  taken  relative  to  E , it  follows  that 

U(T  n D)  < E p(T  P bd(W  )]  = E U(T  p [cl  (W  ) ' int(W  )]) 

ycY  y y 

= I g[T  n cl(Wy)l  - E W[T  P int(Wy)] 

* 0 (since  each  term  is  finite)  . 

The  result  now  follows  because  T is  arbitrary.  | | 

Corollary  5.3.1;  Given  a data  point  a selected  at  random  from  A,  the 
probability  that  v is  discontinuous  at  a is  zero. 

5.2  Concavity  of  v with  Respect  to  Cost  Data 

Concerned  only  with  objective  function  data,  the  problem  (i.e., 
(5.1)  or  (3.9))  can  be  expressed  as 


minimize  f(c;x,y) 
subject  to:  (x,y)  e F(a)  . 


(5.6) 


The  optimal  value  function  v(c)  H v(c,a),  a fixed,  is  continuous  on  e"^ 
where  n is  the  dimension  of  c,  provided  that  f is  continuous  on  E'^xF(a). 
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It  also  holds  that  v(c)  is  concave  on  if  f is  concave  in  c. 

The  function  f is  concave  in  c if  for  any  (x,y)  e F(a)  and  X e (0,1], 
f (XCj^+ (1-X)  C2;x,y)  Xf  (Cj^;x,y)  + (1-X)  f (c2?x,y)  . This  is  a very  mild 
restriction;  in  particular,  f linear  in  c permits  f to  represent  any 
polynomial  on  X x Y. 

Theorem  5.4;  If  f is  concave  in  c,  then  v(c)  is  concave  on 

Proof;  Let  c H Xc^  + (l-X)c^  where  X e [0,1]. 

v(c)  = minimum  f (c;x,y) | (x,y)  e F(a) 

XGX,ycY 

\ 2 

^minimum  Xf{c  ;x,y)  + (l-X)f(c  ;x,y)  | (x,y)  c F(a) 
xeX,yeY 

1 2 
^minimum  f(c  ;x,y)  | (x,y)  eF(a)  + minimum  (l-X)f(c  ;x,y)  | (x,y)  eF  (a) 

xeX,yeY  xeX,yGY 

= Xv(c^)  + (l-X)v(c^)  . II 

5. 3 Quasiconvexity  of  Constraint  Functions 

A function  g(a;x)  is  quasi  convex  on  A x x if  for  e A x x, 

c A X X,  and  X e [0,1], 

g(Xaj^+(l-X)a2;XXj^+(l-X)x2)  _<  max  (g  (a^  ,x^^)  ,g  (a^  jX^)  ] . (5.7) 

This  definition  is  extended  in  the  obvious  way  to  a function  g(a;x,y) 
quasi  convex  on  A x x @ y.  The  vector  function  G is  quasiconvex  if  each 
con.ponent  function  g is  quasiconvex.  A function  g is  quasiconcave  if 
-g  is  quasiconvex. 

Lemma  5.5:  If  N is  an  open  subset  of  A euid  F(’)  is  closed  on  cl(N), 

then  cl(N)  c A (i.e.,  F(a)  ^0  for  a g cl (N) ) . 

Proof : It  follows  from  Berge  [4],  Theorem  2 (Chapter  6),  that  F(d)  = 0 

implies  the  existence  of  a neighborhood  about  a on  which  F(*)  = 0.  If 
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a c S = cl(N)-N  there  can  be  no  such  neighborhood  since  N c A.  Hence, 

I' (a)  ft  fl  emd  S c A. 

Lenna  5.6:  Let  N.(a)  be  a ^-neighborhood  of  a and  define  S = cl[N.(a)1 

6 6 

- N.(a).  Then  for  any  o c N,{a)  there  is  em  a c S such  that  o “ Xa  + 

a 6 

(l-X)a  where  X e [0,1]. 

Proof:  For  any  a e S,  |a-a|  - 6.  Let  a ■ a + 6 ° °.. . Then  a = Xa  + 

||a-al| 

(l-X)a  where  0 < X = — ||a-o|  1.  (X  = 0 if  and  only  if  o = a.)  | | 

Theorem  5.7:  Let  N be  an  arbitrary  open  subset  of  A—.  Suppose  that: 

(a)  X is  convex  (as  well  as  bounded) , 

(b)  G is  quasiconvex  and  l.s.c.  on  cl  (N)  x x @ y, 

(c)  each  component  of  H is  either  independent  of  a or  linear  on 
cl (N)  X X @ y,  and 

(d)  f is  continuous  on  cl(N)  x x @ y. 

Then  v^  is  continuous  (and  finite)  on  N and  v is  continuous  (emd  finite) 
at  all  points  in  N at  which  y is  optimal. 


Proof;  is  closed  on  cl  (N)  by  Theorem  3.9.  Hence,  cl  (N)  ^ A— by 

Lenina  5.5.  To  see  that  F— (•)  is  open  on  N,  let  x z F~(a)  where  a e N 
)c  “ K 

and  let  a ->  a.  Since  N is  open,  a e N for  k large.  By  Lemma  5.6 

''k  k *\k  “ 

there  exist  a e S H cl(N)-N  such  that  a = Xj^d  + (l-Xj^)a  where  neces- 

-k  ^k  ^k  *“ 

sarily  X,  -♦  J.  Now  S c a—  so  there  exists  x such  that  G(d  ,*x  ,y)  < 0 

k ~ y ~ 

and  H(d  ;x  ,y)  = 0.  Let  x = X^^x  + (l-Xj^)x  x (since  each  x belongs 


to  the  bounded  set  X).  By  quasiconvexity  of  G, 


G(a*^;x*^,y)  £ max  {G(d*';x*^,y)  ,G(a;x,y)  } < 0 . (5.8) 

The  component  functions,  h^ , of  H that  do  not  depend  on  a have  no  influ- 
ence on  the  continuity  of  F— , so  we  may  ignore  them.  The  other 
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components  satisfy 


h(a^;x^,y)  - Xj^h(a*^sx*^,y)  + (l-Xj^)h (a;x,y)  ■ 0 


(5.9) 


k k — — 

By  (5.8)  and  (5.9),  x e F~(a  ) so  that  ?*“(•)  Is  open  at  a.  Since  a is 

an  arbitrary  element  of  the  open  set  N,  it  follows  that  F^*)  is  open  on 

N.  Consequently,  F“(*)  is  continuous  on  N and  by  Theorem  3.4  (with  y 

fixed)  we  conclude  that  v—  is  continuous  on  N;  v—  is  finite  on  N since 

y y 

N c A— and  f is  bounded  (continuous  on  tl.e  compact  set  cl(N)  x x)  . Final- 
ly, if  y is  optimal  at  a e N,  then  a e int  (A— ) and  v—  is  continuous  at 

y y 

a so  that  v is  continuous  at  a hy  Theorcni  4.3.  | | 

Corollary  5.7.1;  Suppose  y is  e-optimal  at  a g pi(A— |a).  Given  condi- 
tions (a)  through  (d)  , v is  c-contiruous  relative  to  A at  a. 

Proof;  (Immediate  from  Theorems  4.3  and  5.7). 

The  condition  that  a component  h of  H be  linear  on  a product  set 
N X X permits  the  form 

h(a;x,y)  = i(x,y)  - ay  - a 

where  £(x,y)  is  linear  in  x for  y fixed.  The  form  ax  is  not  acceptable 
in  equality  constraints  since  it  is  not  linear  on  N x x.  Quasiconvexity 
of  the  inequality  functions  is  also  a strong  condition;  it  too  precludes 
the  form  ax  for  a 0 and  x ^ 0.  In  fact,  ax  is  quasiconcave  for  non- 
negative a and  x. 

Remark : ox  is  quasiconvex  for  a _<  0 and  x ^ 0. 

Proof:  ax  is  quasiconvex  for  a £ 0 and  x ^ 0 if  and  only  if  the  sets 

{(a,x)|a^0,  x>^0,  ax  > y}  ^te  convex  for  any  y ^ 0 (Theorem  2.10, 
Zangwill  [24]).  It  is  sufficient  to  consider  a and  x as  scalars  since 
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r. 


fiPfippiflimL''  '-I.FJJi.Ly-  «-l.i Jll,  .!  i-.  4-'  ' J"J'  '"I,  ‘-nw-niHi)  y .|,r  ■ 


if  C,  are  convex  sets  in  E , then  C,  * 

Ip  1 


X C is  convex  in 
P 


• n 


(Theorem  3.5,  Rockafellar  [19]).  Given  >_  y and  OjX^  ^ y we  need 

% 

to  establish  that 

[Xa^  + (l-Xja^l *tXx^  + (1-X)x2l  > Y • (5.10) 

If  “ 0 or  02  “ 0,  then  y “ 0 and  the  result  is  iimnediate  since 
l.h.s.(5.10)  ^ 0.  We  will  asstxne  that  o^  > 0 and  02  > 0.  Now, 

l.h.s.(5.10)  = (1"X)^02X2  + X(l-X)(o2Xj^  + Oj^X2) 

2 2 2 ^1 
> (X  + (1-X)  1y  + (X-X  ) (—  + — )y  > y 

“1  “2  ■ 

“2  “1 

since  — + — >2.  II 

'^1  “2 

An  ex2unple  of  a more  general  quasiconvex  form  is 

qj^(o;y)  + q2(x,y)  + o^^^x  + o^^^y  + Oq 

where  y is  fixed,  x ^ 0,  o^^^  ^ 0,  q^  if  quasiconvex  in  o,  and  q2  is 
quasiconvex  in  x. 

5.4  SuiTBiary  cind  Conclusions 

Two  interesting  special  applications  of  Theorems  5.1,  5.2,  and  5.3 
are  to  LP  problems  and  linear  MIP  problems.  The  conclusions  in  these 
theorems  hold  for  all  bounded  linear  MIP  problems.  Applied  to  hP  prob- 
lems, Theorems  5.1  cuid  5.3  can  be  summarized  as  follows:  in  any 

(bounded)  LP  problem  the  set  Z = {(b,d)  |-“  < v(a)  < «}  is  convex  and 
the  optimal  value  v is  (a)  a concave  function  of  the  objective  function 
data,  (b)  a convex  function  of  the  right-side  data,  and  (c)  is  continu- 
ous at  a point  a if  (b,d)  c int(Z). 

It  may  appear  at  first  that  the  convexity  assumption  on  f in 
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Theorem  5.1  and  the  concavity  assun^tion  on  f in  Theorem  5.3  preclude 
aimultaneoue  application  of  these  theorems  in  all  but  the  linear  case. 


Indeed,  f can  be  both  concave  in  c and  convex  in  x.  The  simple  quad- 
2 2 

ratio:  c^x^  ^2^2'  example,  is  linear  in  c and  convex  in  x for 

Ci,C2  i 0. 

In  the  case  of  MIP  problems  with  convex  objective  emd  constraint 

functions  (linear  equality  constraint  functions) , the  continuity  of  v 

at  a point  is  assured  by  a single  interiority  condition  on  only  the 

right-side  data.  Viewed  as  a function  only  of  the  right-side  data,  the 

optimal  value  is  piecewise  convex.  This  follows  since  each  subproblem 

(y  fixed)  has  optimal  value  convex  in  the  right-side  data  and  v is  the 

pointwise  minimixn  of  these  functions:  v(a)  <■  min{v  (a)}.  As  shown 

yeY  ^ 

(one-dimensionally)  in  Figure  5.1,  v can  be  discontinuous  at  (and  only 
at)  right-side  points  where  yeY  oecome  infeasible.  The  optimal  value 
function  is  shown  in  bold  face. 


v(b,d) 


Figure  5.1.  The  Optimal  Value  is  Piecewise  Convex 
with  Respect  to  the  Right-Sice  Data. 
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In  the  case  where  the  (Inequality)  constrednt  functions  are  quasi- 
convex  in  a product  space,  continuity  of  v follows  without  an  explicit 
interiority  requirement.  However,  it  was  pointed  out  that  quasiconvex- 
ity jointly  in  a and  x is  a quite  severe  assumption;  the  severity  is 
mitigated  somewhat  in  Theorem  5.7  by  requiring  quasiconvexity  only  on  a 
neighborhood  N of  a.  In  one  respect,  the  conditions  of  Theorem  5.7 
permit  a more  general  application  th2un  do  those  of  Theorem  5.1  in  that 
discontinuous  constraint  functions  are  allowed  — a function  can  be 
boT.b  quaisiconvex  and  lower  semicontinuous  and  yet  be  discontinuous. 
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CHAPTER  6 


CONTINUITY  PROPERTIES  OF  LINEAR  MIP  PROBLEMS 


The  general  linear  mixed  integer  programming  problem  is  expressed 


minimize  c*x  + c"y 
(x,y) eU 

subject  to:  G^^x  + G2y  b 

HiX  H^y  = d 


(6.1) 


where  U^xxy,  xisa  bounded  polytope  in  E^,  Y is  a finite  set  in 
E^,  c'  e E^,  c"  c E*^,  b has  m^^  components  and  d has  components;  G^^ 
is  em  m^^  X p matrix,  G^  is  m^^  x q,  is  m^  x p and  is  m^  x q.  Let 
n « p+q  and  m = m +m  . Let  c e e''  denote  (c',c")  and  define  G = (G  ’.G  ) , 

X ^ X • ^ 

H H 

The  vector  a will  denote  all  elements  of  c,  G,  H,  b,  and  d.  We 
will  assume  that  these  pareuneters  are  constants;  however,  the  results 
in  this  section  do  not  rule  out  the  case  where  a,  i.e.,  (C,G,H,b,d) 
varies  continuously  with  respect  to  auxiliary  parameters  8;  v is  conti- 
nuous with  respect  to  6 if  v is  continuous  with  respect  to  o.  Problem 
(6.1)  being  a special  case  of  a convex  problem,  it  follows  from  results 
of  the  preceding  chapter  that  v is  continuous  with  respect  to  a if  v is 
continuous  with  respect  to  b and  d (relative  to  e"*)  . 

6.1  Basic  Properties  of  the  Optimal  Value  Fujiction 


Since  X and  Y are  bounded  sets,  the  objective  function  is  finite 
for  all  choices  of  c'  cuid  c".  Consequently,  v(a)  is  finite  for  all 
a E A,  where  A again  denotes  the  feasible  parcuneter  set:  {a|F(a)  0}. 

We  define  v(a)  = “>  for  a A. 
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One  of  the  roost  significant  continuity  properties  of  linear  MTP 


problems  follows  immediately  from  Theorem  3.10: 


Theorem  6.1:  v(*)  is  l.s.c.  on  A. 


Thus,  a "small*  perturbation  in  o cannot  induce  a discrete  reduction 
in  the  optimal  value.  More  precisely,  at  any  point  a c A emd  for  cmy 
e > 0,  there  exists  a neighborhood  about  a such  that  the  infimal  value 
V at  amy  point  in  thir.  neighborhood  is  not  less  than  v(a)-c. 

A property  that  can  be  viewed  as  a cocqpanion  to  Theorem  6.1  is  that 
each  set  A^  is  closed.  This  is  equivalent  to  the  following: 

Theorem  6.2:  There  exists  a neighborhood  N(a)  aUoout  each  point  .t  such 

that  Y(a)  c Y(a)  for  all  a c N(a). 

Proof:  If  a I?  A there  exists  a N(a)  not  in  A so  that  Y(a)  = 0 for  all 

a e N(a).  For  a e A,  F(*)  is  closed  at  a by  Theorem  3.9  and  the  result 

obtains  from  Theorem  3.11.  || 

This  result  states  that  any  value  of  y that  is  infeasible 
at  a cannot  be  feasible  at  any  point  arbitrarily  close  to  a.  That  is, 
each  set  is  closed.  The  consequence  is  that  small  perturbations  in 

a cannot  admit  "new"  y vectors  (i.e.,  y vectors  that  are  not  feasi- 

ble at  a)  so  that  any  increment  to  the  feasible  domain  of  problem  (6.1) 
is  due  to  admission  of  additional  values  for  the  continuous  variables  x. 
This  observation  will  lend  insight  into  some  of  our  later  results. 

Several  elementary  properties  of  v in  problem  (6.1)  are  easily  ob- 
served. These  regard  the  behavior  of  v with  respect  to  certain  of  the 
parameters  when  the  other  parameters  are  held  fixed.  To  avoid  confusion 


we  define  precisely  what  we  mean  by  "with  respect  to  certain  parameters." 
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Letting  a denote  a fixed  point,  we  define  the  projected  functions: 


v(c)  E v(c,G,H,b,d) 
v(b,d)  E v(c,G,H,b,d) 

(6.2) 

v(b)  E v(c,G,H,b,d) 
v(G,H)  E v(c,G,H,b,d)  . 

When  y is  fixed  (and  c”,  G , and  H are  fixed),  the  subfunctions  v de- 

1 i y 

pend  only  on  c*,  G^^,  b,  and  d.  In  li)ce  manner,  define 

Vy(c')  E v^(c' ,c",G,H,b,d) 

V (b,d)  E V (c,G,H,b,d) 

^ (6.3) 

Vy(b)  E Vy(c,G,H,b,d) 

Vy(G^,H^)  = Vy(c,Gj^,G2,H^,H2,b,d)  . 

Theorem  6.3: 

(a)  v(c)  is  piecewise  linear  and  concave  (hence,  continuous)  cn  E*^. 

(b)  v(c,G,b)  is  continuous  at  (c,G,b)  if  v(b)  is  continuous  at  b. 

(c)  v(b)  is  monotone  nonincreasing  with  respect  to  b. 

(d)  If  X ^ 0 and  y ^ 0 is  required,  then  v(G,H)  is  nvanotone  nondecreas- 
ing with  respect  to  G and  H,  and  v(c)  is  monotone  nondecreasing. 

Proof: 

(a)  The  convex  hull  of  the  bounded  domain  F(a)  in  problem  (6.1)  can  be 
characterized  by  a finite  collection  S of  linear  constraints,  the 
extreme  points  of  which  satisfy  the  integer  requirements.  Problem 
(6.1)  at  a and  the  LP  problem:  min  c’x  + c"yls  are  equivalent  in 

the  sense  that  they  possess  the  some  optimal  solutions  and  solution 
values.  The  result  follows  from  LP  theory  since  S is  invariant 
with  respect  to  c (see  Theorem  6.4(b)). 
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(b)  v(b)  continuous  at  b implies  that  v(6)  (see  paragraph  3.3)  is  con- 
tinuous at  0.  The  result  is  immediate  from  Theorem  3.12. 

(c)  An  increment  in  b increases  the  feasible  domain;  v(b)  may  there- 
fore only  decrease  in  value  or  remain  the  same. 

(d)  An  increment  in  G reduces  the  size  of  the  feasible  doiucin  so  v(G) 

may  only  increase  in  value  or  remain  the  same.  | | 

6 . 2 Continuity  Properties  of  the  LP  Subproblems — A Summary 

When  y is  fixed  in  problem  (6.1)  the  result  is  eui  LP  subproblem. 

In  view  of  Theorem  4.3  we  are  interested  in  the  continuity  properties  of 
problems.  Probably  the  most  general  LP  continuity  result  for  the 
bounded  case  is  expressed  in  the  next  proposition.  Let  y be  fixed  euid 
define 


Zy  i {(b,d)  e E I Fy(G,H,b,d)  ^ 0}  . 


(6.4) 


The  set  Z^  is  precisely  the  set  of  values  of  (b,d)  for  which 


-«•  < Vy(b,d)  < “ . 


(6.5) 


Theorem  6.4; 

(a)  Z is  convex. 

y 

(b)  v^(c')  is  piecewise  linear,  concave,  and  continuous  on  E^. 

(c)  v^(b,d)  is  convex  and  continuous  on  Z^. 

(d)  v^  is  continuous  with  respect  to  (c' ,G^  ,b,d)  at  a if  (b,d)  e 

int (Z  ) . 

y 

All  statements  of  Theorem  6.4,  except  for  piecewise  linearity  of 
v (c)  , follow  as  special  cases  of  Theorems  5.1  and  5.3  which  hold  for 

y 

convex  programs.  To  see  that  v^(c')  is  piecewise  lineeir,  let  B denote 
the  set  of  basic  feasible  solutions,  x.  Then 
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V (c')  - minimum  {c'x} 

^ X e B 

which  is  the  mlnimun  over  a finite  collection  of  linear  functions. 

Thus,  Vy(c')  is  a piecewise  linear  (and  concave)  function  of  c'  with  a 
finite  number  of  "pieces."  (By  similarly  looking  at  the  dual  problem 
it  follows  that  v^(b,d)  is  piecewise  linear  (wd  convex).) 

These  properties  are  applicable  also  to  the  unbounded  case  (that 
is,  when  X is  not  necessarily  bounded)  by  redefining  to  be  the  set 
of  (b,d)  for  which  (6.5)  holds,  and  by  restricting  c to  the  subset  of 
eP  for  vdiich  -“  < v(c)  < <«>.  These  sets  are  also  easily  shown  to  be 
convex . 

Statement  (d)  says  that  if  any  "small"  perturbation  in  (b,d)  is 
feasible  (i.e. , admits  a feasible  solution  at  G,H),  then  a "small"  per- 
turbation in  all  of  the  parameters  will  induce  only  a small  change  in 
Vy.  As  a special  case  of  (d)  we  have  that  continuous  at 

(Gi,Hi)  if  (b,d)  e int(Z^);  this  is  particularly  intriguing  in  that 
continuity  with  respect  to  the  elements  of  G^^  and  requires  a condi- 
tion on  (b,d)  but  none  on  (G,H)  . Indeed,  the  pattern  established  by 
(b)  euid  (c)  could  lead  one  to  an  incorrect  conclusion  regarding  conti- 
nuity with  respect  to  G and  H — although  v^(b,d)  is  continuous  on  a 
domain  for  (b,d)  and  v (c)  is  continuous  on  a domain  for  c,  it  is  not 

y 

true  that  v(G,H)  is  continuous  on  cin  analogous  domain  for  (G,H).  Con- 
sider the  problem  (taken  from  Gale  [10]); 

mciximize  x 

xc[0,l]  (6.6) 

subject  to:  ax  £ 0 

where  "a"  is  a scalar.  Any  value  for  "a"  from  the  domain  (-<*>,“)  admits 
a finite  optimal  solution,  yet  the  infimal  value  function  is  not 
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continuous  at  a 


v(a) 


(1,  a £ 0 
0,  a > 0 . 


This  exa.<iple  does  not  satisfy  the  interiority  condition  of  statement 
(d)  . Viewing  the  constraint  as  eut  ^ b,  b « 0 /f  int  {b|o*x  b}  ■ (0,®). 

In  LP  terminology,  Iheorem  6.4(d)  says  that  the  optimal  value  of 
a bounded  LP  problem  is  continuous  with  respect  to  all  parameters  (at 
the  given  point)  if  the  resource  vector  lies  in  the  interior  of  its 
domain  of  feasibility  (defined  with  the  technology  and  cost  coefficients 
fixed)  . The  usual  conditions  for  LP  continuity  are  expressed  in  terms 
of  "regularity"  or  "boundedness  of  the  primal  and  dual  optimal  solution 
sets"  (see,  for  instance.  Gale  [10],  Bereanu  [3l  > Hoffman  emd  Karp  [15], 
and  Williams  [21]).  If  we  let  W(a)  denote  the  optimal  dual  solution 
set  at  a,  then  M(a)  amd  W(a)  bounded  imply  that  v for  the  LP  is  continu- 
ous at  a (see  [15]  for  a proof).  The  condition  given  in  6.4(d)  is  sim- 
pler in  the  sense  that  it  is  (usually)  easier  to  perceive  and  to  apply 
when  dealing  with  entire  classes  of  problems.  Furthermore,  a similar 
condition  (actually  the  same)  is  needed  to  assure  continuity  in  the  MIP 
context.  We  must  enphasize,  however,  that  this  result  rexies  on  bounded- 
ness of  X. 

If  X is  not  bounded,  the  interiority  condition  of  6.4(d)  is  not 
sufficient  for  continuity  of  the  optimal  value  (with  respect  to  tech- 
nology coefficients).  The  following  problem  is  taiken  from  Bereamu  [3]: 


minimize  x. 


(6.7) 


subject  to;  x^^  + aX2  ^ b 


95 


I 

This  result  states  that  if  small  perturbations  in  (b,d)  do  not 
destroy  feasibility  when  y (optimal  at  a)  is  fixed,  then  v is  continu- 
ous at  a.  The  conputationed  usefulness  of  this  result  for  continuity 
analysis  is  that  one  needs  to  address  only  the  right-hand  side  param- 
[ eters  (b,d) . 

i 

The  interiority  condition  in  Theorem  6.5  is  sufficient  but  not 
necessary  for  continuity  of  v (whereas  it  is  both  necessary  and  suffi- 
cient for  LP  problems)  . A simple  example  which  shows  that  interiority 
is  not  necessary  is  the  following: 


*/ 

-'Notice  that,  in  fact,  v is  not  even  l.s.c.  at  (0,1).  Thus  (6.7)  demon- 
strates that  Theorems  3.2,  3.4,  5.7,  cind  6.1,  to  name  a few,  are  not 
valid  without  some  sort  of  boundedness  assumption.  Hogan  [16]  shows 
that,  with  reference  to  the  po^nt  a,  it  is  sufficient  to  assume  that 

there  exists  a neighborhood  N(a)  such  that  cl  [ U_F(a)]  is  compact. 

aeN(a) 

This,  of  course,  is  weaker  them  the  assumption  that  X is  compact. 
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minimize  0 
y*>0  or  1 

subject  to-  a-l<^y£a. 

Take  a - 1.  Thus,  the  con.'itraint  is:  0 V f.  1-  Both  y = 0 amd  y = 1 

are  feasible  amd  optimal,  and 

Zq  = {aja  - 1 £ 0 £ a}  = [0,1] 

= (a|a  - 1 £ 1 £ a)  = (1,2)  . 

Hence,  a = 1 is  not  in  the  interior  of  for  amy  y that  is  optimal  at 
a,  yet  v(a)  is  obviously  continuous  at  a = 1. 

A situation  where  the  interiority  condition  of  Theorem  6.5  is  both 
necessary  and  sufficient  is  when  y,  optimal  at  u,  is  unique. 


Theorem  6.6:  If  y is  uniquely  optimal  at  a,  then  v is  continuous  at  a 

if  and  only  if  (b,d)  c int(Z— ). 

Proof;  Sufficiency  is  the  content  of  Theorem  6.5.  We  will  establish 
the  contrapositive  of  the  converse.  For  ease  of  exposition,  let  R = 
(b,d)  . Suppose  B r bd(Z— ) where  y is  optimal  and  unique  at  a.  By  (6.5) 
we  see  that  v(P)  is  not  continuous  at  p since  v— (p)  < for  B c Z—  auid 

y y 

— — — 

v— (P)  = for  B / Z-.  Therefore,  there  exists  a sequence  (B  },  B B, 

y y 

such  that 


lim  V— (B*^)  5^<  V— (p) 

k -«>  y y 

k k k 

Suppose  y is  optimal  at  B , i.e.,  at  a 


(6.8) 


— — — 

(c,G,H,B  ).  Since  Y is  a 


finite  set,  there  must  be  a y^  such  that  y^  = y^  for  infinitely-many  k. 


k . 


T K 0 

That  is,  there  exists  a subsequence  fp  } of  (B  } such  that  y is  opti- 
k . 

mal  on  {p  ^}.  It  follows  from  Theorem  6.2  that  Z ^ is  closed  so  that 
B c Z „ since  B ^ ► B (i.e.,  y is  feasible  at  B)  . How,  by  Tlieorem 

yU 


97 


6.4(b),  V ,.(0)  Is  continuous  on  Z so  that 

yO  yU 

_ k.  _ _ 

lim  V q(B  ^)  - V q(3)  . 

kj-H»  y y 

0 

Since  y is  optimal  on  (3  •'},  v (6  ■^>  ■ v(a  ^).  (Recall  that  a -*  i 
k k _ 

(c,G,H,3  ; hence,  a ^ o.)  Thus,  (6.9)  implies  that 


(6.9) 


lim  v(o  -^)  - V ^(3)  . 


If  V is  continuous  at  a,  it  follows  from  (6.10)  that 


(6.10) 


V q(3)  = v(a)  . 

y 


(6.11) 


But  V (3)  * V (a)  and  v(a)  * v— (a)  so  that  (6.11)  implies  v (a)  = 

yW  yU  y yO 

V— (a)  . This  means  that  y*^  is  optimal  at  a since  y is  optimal,  thus 
contradicting  the  assumption  that  y is  unique.  We  conclude  that  v 
cannot  be  continuous  at  a. 


With  regard  to  inequality  constraints,  the  interiority  condition 
could  be  replaced  by  strong  feasibility,  a condition  that  is  relatively 
easy  to  observe.  In  the  case  of  equality  constraints,  on  the  other 
hand,  the  concept  of  strong  feasibility  is  not  as  useful  or  appliccible. 
Nevertheless,  for  certain  types  of  equality  constraints  it  may  make 
sense  to  speak  of  strong  feasibility.  In  numerous  applications,  equal- 
ity constrciints  involve  only  the  discrete  variables.  That  is,  they 
often  have  the  form  H^y  = d.  Furthermore,  for  this  form,  and  d 
usually  are  integral.  An  example  is  the  set  of  configuration  con- 
straints: E y,  = I.,  where  I.  is  an  integer  and  i = l,2,...,m_.  The 

. , ] 1 1 2 

question  of  continuity  does  not  apply  to  such  parameters,  for  we  are 
not  interested  in  (small)  perturbations  of  integer-valued  parameters. 
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Consideration  of  such  equality  constraints  is  encompassed  in  the  follow- 
ing statement. 

Theorem  6.7r  v is  e-contlnuous  with  respect  to  (c,G,b)  at  (c,G,b)  and 
M^(‘)  is  cloned  with  respect  to  (c,G,b)  at  (c,G,b)  if  for  some  y e-opti- 
mal  at  Qi  H (c,G,H,b,d)  there  exists  an  x £ U such  that  Gj^x  + G^y  < b. 

Proof ; (Equality  constraints  are  encompassed  by  the  set  U. ) The  result 
follows  directly  from  Theorem  4.5  since > by  definition,  y is  s.f.  at  a 
if  Gj^x  + G^y  < b for  some  x e U (see  paragraph  4.3).  | | 

Sometimes  the  constraints  that  appear  in  well-known  models  as 
equalities  could  be  exprest.3d  as  inequalities  for  the  purpose  of  a con- 
tinuity analysis.  For  instance,  the  demcUid  constraints  in  facility 
location  models  are  usually  expressed  as  equalities  because  it  is  obvi- 
ous that  equality  will  hold  in  an  optimal  solution  even  if  the  con- 
straints are  treated  as  inequalities  (demand  must  be  met  or  exceeded) . 

Corollary  6.7.1;  In  the  purt  integer  problem;  min  cy|Gy  ^ b,  v(»)  is 

_ _yeY  _ _ 

continuous  at  a 3 (c,G,b)  if  and  only  if  Gy  < b for  some  y optimal  at  a. 

Proof;  Necessity  is  obvious  since  if  equality  holds  in  emy  constraint, 
a change  in  b could  render  y infeasible  (of  course,  directional  contin- 
uity is  possible).  Sufficiency  follows  from  Theorem  6.7. 

6.4  Application  Examples 

The  first  example  demonstrates  the  application  of  Theorems  6.5  and 

6.6. 

Example  6.1;  Organizational  Budgeting 


( 


'i 

i 


( 
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maximize 

x.^0 

yj  - 0 or  1 


E c y - cl  r X ) 
j-1  J J ^ i-1 


subject  to:  E a,  .y,  £ L + x . , i 

j-1  ^ J ^ 


(6.12) 


E X.  ^ b 
i-1  ^ 


A company  with  p divisions  is  considering  undertaking  certain  of  q dif- 
ferent projects.  Each  project  requires  mixed  participation  of  the 
different  divisions.  Each  division  has  its  own  budget  (in  terms  of 
money,  personnel,  etc.)  and,  in  addition,  the  company  has  recognized  a 
budget  b to  be  allocated  among  the  p divisions.  The  problem  is  to 
select  a subset  of  the  q projects  and  to  allocate  the  budget  b to  the 
p divisions  in  a way  that  maximizes  return. 

The  parameters  may  be  interpreted  as  follows: 


c . = 
3 

= 


a.  . 
13 


"i 

b 


return  (expected)  on  project  j,  (j  * l,2,...,q) 
per  unit  penalty  for  using  company  support  (b) 
division  i expense  for  its  role  in  project  j 
division  i budgeteury  capacity 
available  coiqjciny  support. 


The  variable  y^  is  1 if  project  j is  to  be  undertaken  and  0 if  not;  the 

variable  x^  is  the  amount  of  company  support  allocated  to  division  i. 
Suppose  that  y is  held  fixed  at  y.  Then  x must  satisfy  x ^ 0, 

a.y  - L.  < X.  (i  = l,...,p),  and  Ex.  < b,  vrtiere  a.  E (a.,,...,a.  ). 
11—1  1 — 1 il  iq 

The  parameters  and  b must  satisfy 


b ^ E max  {0,a.y  - L. } 
i=l 


(6.13) 


^md  L^  i 0 (i  ■ 1, . . . ,p) . This  me^m8  that 


Z - {(b,L,,...,L  )Il  > 0,  (6.13)  holds}  . (6.14) 

y 1 p 


By  Theorem  6.5,  the  maximal  value  function  v is  continuous  at 

(Cq  , . . . , c^ # ^11  ^ ‘ ^ ^1^  * * * * ^ ^pl  ^ * * * * ^p<j  ^ ^1  ^ * * * ^ (^  ^ i*^ , . . . ,L^) 

satisfies 


b > Z (a^y  - L^) 
iel 

(b,Lj^,...,Lp)  > 0 


(6.15) 


where  I = {i|a^y-L^  ^ 0,  i » l,2,...,p).  It  can  be  assumed  without  loss 
of  generality  that  L > 0.  Condition  (6.15)  means  that  with  y fixed  at 
y there  exists  a feasible  value  of  x such  that  Ex^  < b. 

If  b = 0,  problem  (6.12)  is  a pure  integer  problem.  In  this  case, 

V is  continuous  with  respect  to  all  pareuneters  (b  excluded)  if 
(Lj^,...,L^)  > 0 and  > i^y,  i = l,...,p.  That  is,  continuity  holds 
if  each  of  the  divisions  requires  less  them  its  budgetary  capacity  (this 
result  is  obvious)  . 

In  the  general  case  (b  > 0)  , continuity  of  v holds  if  not  all  of 
the  company  support  b is  allocated  in  an  optimal  solution.  If  this  con- 
dition does  not  hold  at  a derived  optimal  solution,  v might  still  be 
continuous  if  y is  not  unique.  Precisely,  v is  continuous  at  a if 
(6.15)  holds  for  some  y that  is  optimal  at  a;  if  y is  unique,  v is  con- 
tinuous at  a if  and  only  if  (6.15)  holds. 

The  conclusions  in  the  foregoing  example  are  derived  via  an  expli- 
cit characterization  of  Z^.  In  some  applications,  deriving  such  a 
characterization  may  prove  to  be  an  overly  tedious  exercise.  It  be- 
hooves us  to  establish  implicit  means  for  determining  interiority. 
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For  the  case  where  there  are  no  equality  constraints  (m^  - 0)  , the 

existence  of  an  x c X for  which  G x G y < b implies  that  b e int(Z—  ) . 

X z y 

This  strict  Inequality  (in  each  component)  is  the  condition  that  y is 
strongly  feasible  (s.f.)  at  a:  (in  the  pure  integer  case,  strong  feas- 
ibility means  that  strict  inequality  holds  in  all  constraints  at  y)  . 

In  this  case.  Theorem  6.5  applies:  v is  e-continuous  at  o if  there 
is  a y G-optimal  euid  s.f.  at  a. 

Exang)le  6.2:  Multicommodity  Distribution  System  Design 

The  following  distribution  system  design  problem  is  addressed  by 
Geoffrion  and  Graves  [12] . 


Minimize  L 

x^O  ijkieN 

y,z-0,l 

subject  to: 

(1) 

(2) 

j *ijkl  ■ ^ “il  ’ ° (6.16) 

all  t 
k 

(3) 

(4) 

u 

(5) 

Linear  configuration  constraints  on  y and  z 

where 


and 


X.  „ 

i]k«. 


y 


k£ 


z 


k 


N = {ijki  Is..  >0  and  D. „ >0} 

'13  i£ 

amount  of  commodity  i shipped  from  plant  j through 
distribution  center  k to  customer  zone  I 

(1,  if  center  k serves  zone  Z 
0,  otherwise 

(1,  if  a center  is  acquired  at  site  k 
0,  otherwise. 


t 


Pareuneter  definitions  and  a discussion  of  the  model  are  given  in  [12] . 
(The  problem  is  bounded  since  ^ Notice  that 

(2)  may  be  written  as  inequalities: 

J *ijkl  - 

if  we  assune  that  > 0,  for  then  no  would  be  unnecessarily 

large.  Secondly,  (3)  and  (5)  do  not  involve  (continuous)  data  to  be 
analyzed.  We  need,  therefore,  to  address  only  constraints  (1),  (2)', 
and  (4)  , all  of  which  are  inequalities.  Tlie  par£uneters  of  Interest  are 
S - [S,  .],  D « [D..],  the  vectors  L emd  U,  and  the  objective  function 

ij  X 

coefficients  c,  c',  and  c".  Let  a denote  the  given  values  of  these 
parameters. 

Assume  that  the  total  capacity  for  producing  commodity  i exceeds 
the  total  demand  for  i.  That  is, 

E D,  < E S. . , all  i . (6.17) 

. i£  .11 
I j 

Let  (x,y,z)  denote  an  optimal  solution.  For  each  i there  is  a such 

that  E X. , , 0 < S.  , , for  if  not, 
k£  1 1 

E (E  X.  .,  „)  = E S.  . = E (E  X.  ..  .) 
j kj  j ki  j 

. I D. by  (2) 
k 

= E D , by  (3) 

I 


which  contradicts  (6.17).  For  each  i,  let  A.  = S - E x . > 0 


i ij . ij,k£ 

■'i  k£  -'i 


Let  n be  a very  large  number,  and  define 
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(6.18) 


I: 


’i  I 


’‘ijki  “ ■ n ^ ^ 


’‘il  kt  " ’‘ij  kl  ^ • 

•'i  ■'i 


It  is  clear  that  x > 0 i'nd  for  n sufficiently  large, 


(6.19) 


E X,  ,,  . > D.  .y,  . 

^ i]kt  if  ki 


We  have  established  strong  feasibility  with  respect  to  constraints  (1) 
euid  (2)'.  We  cimnot  establish  the  S2une  for  constraints  (4)  because 
■ 0 forces  equality  (for  all  x e X) . However,  the  condition 

(6.20) 


\ “lAt ' 5 \ ‘ 

li 


together  with  (6.19)  would  permit  the  application  of  Theorem  6.7  since 
for  Zj^  * 0,  Lj^,  Uj^,  and  D can  be  perturbed  in  emy  fashion  without  render- 
ing (y,z)  infeasible;  i.e.,  apply  Theorem  6.5  to  the  constraints  in  (4) 


for  which  Zj^  « 0,  and  apply  Theorem  6.7  to  all  other  constraints.  Alter- 


natively, (6.19),  (6.20),  euid  the  subsequent  observation  regarding  those 


k for  which  z^^  * 0,  collectively  imply  that  emy  small  perturbations  in 


S,  D,  L,  2uid  U do  not  render  (y,z)  infeasible.  Continuity  of  v then 
follows  directly  from  Theorem  6.5. 

The  following  conclusions  regarding  problem  (6.16)  are  at  hand 
(e-optimal  y auid  z are  assumed  to  be  available)  . 

(1)  The  optimal  value  function  v is  e-continuous  at  a with  respect  to 
all  parameters  if 


E D,  . < E S . . , all  i 
I j 


^ “lAi  "k’  ^ 1 • 


iy. 
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(2)  If  supply  exceeds  demand  (fot  each  product  i)  and 


*1<  ■ ^ ■'iAc  " ' 'l 

It 

' ”iAt  ■ "k-  " ' "2 ' 

it 

then  V is  e-continuous  with  respect  to  c,  c',  c",  S,  for  k ^ 

Uj^  for  k /(  K^,  emd  with  respect  to  decreases  i*'  (k  e amd 

increases  in  U.  (k  e K ).  If  K (K  ) is  empty,  then  v is  also 

K A X 

e-continuous  with  respect  to  decreases  (increases)  in  D. 

In  this  particular  exarapJe  the  LP  subproblem  that  results  when  the 
integer  variables  are  fixed  involves  only  a subset  of  the  constraints, 
namely  (1)  and  (2)  , amd  therefore  the  LP  problem  does  not  involve  all 
of  the  parauneters  (naunely,  L and  U).  Obviously,  continuity  of  the  LP 

subproblems  is  not  sufficient  (nor  is  it  necessary)  for  continuity  in 
the  MIP  problem.  For  instamce,  in  Theorem  4.3,  the  interiority  condi- 
tion (a)  complements  the  condition  that  the  LP  subproblem  (at  an  optimal 
y)  be  continuous;  the  condition  (a)  is  used  to  assure  that  perturbations 
in  the  parauneteri;  do  not  render  y infeasible.  Theorem  6.5  states  that 
both  of  these  conditions  are  satisfied  by  a single  interiority  condi- 
tion in  the  linear  case. 

Our  reason  for  not  employing  "regularity"  or  "primal  and  dual  solu- 
tion set  boundedness"  conditions  should  be  clear.  Although  such  condi- 
tions are  sufficient  for  LP  continuity,  their  inoosition  in  the  context 
of  LP  subproblems  must  be  supplemented  by  emother  condition  such  as 
a c int(A  ).  In  the  MIP  context,  boundedness  of  the  dual  solution  set 

y 

is  not  a meaningful  concept  (see  [1],  (13],  and  particularly  the  conclu- 


sion in  [14],  regarding  "reimputed  dual  prices"). 
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CHAPTER  7 

SOME  NOTES  ON  MODEL  FORMULATION 

Conditions  have  been  established  in  previous  chapters  that  assure 
that  the  optimal  value  of  a bounded  MIP  problem  varies  continuously 
with  respect  to  the  problem  data.  The  practical  usefulness  of  this 
theory  was  demonstrated  via  application  to  several  prominant  classes  of 
problems.  In  particular,  general  models  were  cmalyzed  for 
capacitated  facility  location  (4.9)  and  (4.13),  dynamic  lot  sizing 
(4.18),  orgemizational  or  hierarchical  capital  budgeting  (6.12),  and 
multiconmodity  distribution  system  design  (6.16). 

Knowledge  that  the  optimal  value  v is  continuous  is  assurance  that 
small  perturbations  in  the  data  will  create  only  a small  change  in  the 
optimal  value.  Knowledge  that  v is  discontinuous  at  a point  is  a warn- 
ing to  the  iJialyst:  the  model  may  be  an  inadequate  representation  of 

the  real  problem;  or  the  discontinuity  may  in  fact  be  realistic,  in 
which  case  the  analyst  should  like  to  know  that  particular  changes  in 
data  are  responsible  for  the  discrete  behavior  of  v. 

Given  a model  that  is  likely  to  exhibit  discontinuous  behavior 
(based  on  continuity  theory)  or  that  has  already  been  demonstrated  to 
be  discontinuous  (e.g.,  by  solving,  observing  the  critical  data  that 
violate  conditions  for  continuity,  and  resolving  with  the  critical  data 
perturbed)  , the  analyst  may  want  to  alter  the  problem  in  a way  that 
precludes  discontinuity.  This  might  be  accomplished  by  simply  revising 
the  data  or  by  improving  upon  the  model  itself. 

It  was  pointed  out  earlier  that  it  is  considerably  more  difficult 
to  formulate  a realistic  MIP  model  than  an  LP  model;  the  reason  stems 
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from  the  fact  that  LP  models  possess  more  favor2d}le  continuity  proper- 
ties. Therefore,  MIP  problems  are  particularly  indigent  of  efficient 
methods  for  formulating/reformulating  realistic  models.  Naturally,  the 
development  of  such  modeling  techniques  must  acknowledge  the  theory  of 
continuity. 

One  way  to  add  realism  to  a model,  thereby  preventing  undesiredjle 
discontinuities,  is  to  treat  certain  critical  parameters  as  explicit 
variables.  A technique  suggested  by  Williams  [22]  is  to  incorporate 
complicating  constraints  into  the  objective  function  via  penalty  func- 
tions. We  will  see  shortly  that  these  two  ideas  can  be  viewed  as  equiv- 
alent. In  light  of  Theorems  3.12,  5.1,  and  6.5,  continuity/discontinui- 
ty of  V can  be  assessed  by  treatment  of  only  the  right-side  data.  These 
data,  then,  are  the  primary  Ceuididates  for  being  represented  by  explicit 
variables.  Replacement  of  data  by  variables  will  be  referred  to  as 
relaxation  of  data  (paragraph  7.1)  . Removal  of  constraints  via  penal- 
ties is  included  also  under  this  title. 

Another  technique,  when  appliccible,  adds  realism  to  the  model  and 
in  so  doing,  improves  the  inherent  continuity  properties.  This  is  the 
treatment  of  discrete  variables  as  quasi-integer  (see  Armstrong  and  Sinha 
[2]).  A variable  y^  is  quasi-binary  if  it  must  satisfy  the  condition 

y.  = 0 or  1 y,  1 u.  (7.1) 

where  Use  of  quasi-binary  variables  in  place  of  0-1  variables 

could,  in  many  applications,  be  more  realistic;  the  improvement  in  con- 
tinuity behavior  is  discussed  in  paragraph  7.2.  Replacing  an  integral 
varicible  value  (e.g.  , 1)  by  an  interval  will  be  referred  to  as  relaxa- 
tion of  integrality. 
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7.1  Relaxation  of  Riaht-Slde  Data 


Constraint  fonrulatlons  that  are  adequate  in  an  LP  model  may  not 


be  acceptable  in  an  MIP  model  in  that  iinrealistic  discontinuities  can 
occur.  Consequently,  greater  care  must  be  taken  in  formulating  an  MIP 
problem  in  order  to  achieve  an  accepteUsle  representation  of  the  real 
problem. 

Typically,  adding  realism  to  a model  results  in  improved  continuity 
properties,  and  vice  versa.  Perhaps  the  most  obvious  means  for  improv- 
ing a model  is  replacement  of  a data  point  by  a (usually  bounded)  vari- 
able. In  a capital  investment  model,  the  budgetary  constraint  appears 


E a.y.  < b . 

11  — 

It  was  illustrated  in  Chapter  1 that  such  a constraint  permits  discon- 
tinuities in  ein  optimal  solution  value;  in  effect,  an  infinite  penalty 
is  assigned  to  all  investment  plans  that  exceed  the  budget  b by  even 
the  slightest  amount.  It  seems  more  realistic  to  allow  b to  vary  and 


to  represent  the  cost  of  any  deviation  from  b in  the  objective  function. 

To  exemplify  these  observations,  we  will  show  how  a discontinuity 
in  a capital  investment  problem  can  be  alleviated  by  replacing  an  inade- 


quate budgetary  constraint  by  one  which  is  more  realistic.  Consider 


the  following  problem  with  four  independent  investment  opportunities; 


maximize  [200yj^  + IBOy^  + 60y^  + 40y^] 
subject  to:  41y^^  + 39y2  + 20y^  + lOy^  1.  h 
y^  = 0 or  1;  i = 1,2, 3, 4 . 


(7.2) 
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For  b ■ 80  the  optimal  solution  is  y*  - (1,1, 0,0)  for  an  optimal  return 
on  investment  of  v - 360.  But  if  b ■ 79.9,  y*  is  infeasible;  the  opti- 
mal return  is  300  with  y ■ (1,0, 1,1).  Hence,  v is  discontinuous  as  a 
function  of  b at  b - 80.  (In  fact,  v is  discontinuous  at  exactly  12 
points:  b - 10,  20,  30,  39,  41,  51,  61,  71,  80,  90,  100,  and  110.  On 
the  other  hauid,  it  sounds  more  reassuring  to  say  that  v is  continuous 
at  all  points  b > 0 except  for  these  12. J 

The  discontinuity  at  b * 80  does  not  reflect  the  true  nature  of  the 
investment  problem.  Surely  it  must  be  possible  to  stretch  a budget  of 
79.9  to  80  if  it  me^ms  a return  of  360  instead  of  300.  The  small 
amount  of  additional  capital  might  be  borrowed  in  order  to  follow  the 
superior  plan.  Figure  7.1  depicts  a simple  representation  of  the  cost 
(value)  of  additional  (excess)  capital.  From  the  figure. 


r.  (b 

- b). 

if 

b 

i b 

1 

r2(b 

- b)  , 

if 

b 

> b . 

(7.3) 

c (cost  of  additional  capital) 


f 


Figure  7.1.  Example  of  Additional  Capital  Cost 
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We  introduce  the  continuous  variables! 


b - b,  if  b > b 


if  b < b , 


b - b,  if  b > b 


if  b < b . 


(7.4) 


Thus,  b - b + - z^.  Incorporating  (7.3)  ^u^d  (7.4)  in  the  model  (7.2), 


we  obtedn 


maximize  [200y^  + IBOy^  + 60y2  + 40y^  - 
subject  to:  41y^  + 39y^  + 20y^  + lOy^  - z^^  + £ b 


^1  - ^2  — ° 


(7.5) 


y^  - 0 or  1;  i = 1,2,3,4  . 

The  optimal  value  function  for  this  problem  will  be  denoted  by  v^  (b)  . 


(Equality  holds  in  the  budget  constraint  if  r^  >0.  Inequality  is  used 
to  permit  the  case  where  r^  = 0.) 

It  is  immediately  clear  that  the  optimal  value  v^(b)  for  formula- 
tion (7.5)  is  continuous  at  any  given  point  b — recall  that  v^  can  be 
discontinuous  only  at  points  b where  some  y e Y becomes  infeasible 
(i.e.,  y is  feasible  for  b ^b  but  infeasible  for  b < b)  , but  in  formu- 
lation (7.5)  every  y e Y is  feasible;  hence,  there  can  be  no  disconti- 
nuities. Normally,  one  would  place  upper  bounds  on  the  z variables. 

In  this  case,  discontinuity  can  occur  at  a point  b only  if  (or  z^) 
is  at  its  upper  bound  in  every  solution  that  is  optimal  at  b (this  fol- 
lows from  Theorem  6.7),  The  favorable  continuity  properties  of  (7.5) 
make  the  model  more  realistic  and,  depending  on  the  provisions  made  in 
the  code,  could  make  the  problem  easier  to  solve  than  problem  (7.2). 

The  graph  of  v(b)  for  problem  (7.2)  is  the  discontinuous  step  func- 
tion shown  by  the  solid  lines  in  Figure  7.2.  This  corresponds  to  r^^  = ® 
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Figure  7.2.  The  Optimal  Value  Function  for  Problems  (7.2)  auid  (7.5). 


0 (see  Figure  7.1)  in  problem  (7.5).  By  comparison,  Figure 


and  r^  ■ 0 (see  Figure  7.1)  in  problem  (7.5).  By  comparison,  Figure 
7.2  shows  also  the  optim^d  value  function  for  problem  (7.5)  for  the  two 
cases,  r^^  - 1.6  and  r^^  >«  0.6.  In  the  latter  cases,  v(b)  is  a continu- 
ous function.  In  the  more  general  case  where  there  are  several  con- 
straints and  b is  a vector,  a plot  similar  to  Figure  7.2  is  possible  b' 
permitting  only  directional  changes  in  b. 

The  consideration  of  financing  extensions  to  capital  budgeting 
problems  is  not  a new  idea:  a thorough  development  of  such  extensions 

has  been  presented  by  Bernhard  (5)  . A similar  approach  was  tci)cen  by 
Davis  and  Larson  ( 7 ] in  the  selection  of  multibenefit  civil  works 
projects. 

The  concept  just  illustrated  can  easily  be  extended  to  a more 
general  case.  Consider  again  problem  (5.1).  This  problem  is  augmented 
as  follows  by  introducing  the  continuous  vector  variables  z and  w. 


fMinimize  f(c;x,y)  + p(z,w) 
(x,y) cU 


(7.6) 


subject  to:  G(a;x,y)  - z b 

. H (a;x,y)  - w = d 

v^ere  U is  a bounded  set  and  p is  cui  arbitrary  bounded  function  of  z 
and  w;  z is  conformable  with  b,  and  w with  d.  It  is  further  assumed 
that  p(0,0)  = 0.  The  function  p can  be  viewed  as  a penalty  for  violat- 
ing the  constraints. 

The  optimal  value  function  for  problem  (7.6)  will  be  denoted  by 
v^(a)  where  a " (c,a,b,d).  As  before,  A denotes  the  set  of  data  points 
a for  which  (7.6)  has  a finite  optimal  value.  The  functionsf,  G,  and  H 
are  assumed  to  be  continuous  on  A X ® Y. 
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Theorem  7.1;  v (•)  is  continuous  on  A. 

Proof;  Let  a c A be  arbitrary.  Since  U c X * Y is  bounded,  3 M < ® ^ 

V (x,y,z,w)  e F(a),  |z||  £M  and  |[w||  £ M.  Hence,  the  domain  for  (x,y,z,w) 
ccin  be  viewed  as  bounded.  Suppose  (x,y,z,w)  is  optima^,  at  a e A.  If 
(b,d)  is  perturbed  to  any  value,  say  (b',d'),  then  (x,y,z',w')  is  feas- 
ible at  a where  (z',w')  5 (z,w)  + (b,d)  - (b',d');  continuity  of  v^  at 
a therefore  follows  from  Theorem  5.1(c).  || 

The  addition  of  variables  (z,w)  can  be  viewed  as  replacing  the 
right-side  data  (b,d)  by  variadiles  (r,,n)  = (b,d)  + (z,w).  The  variables 
(z,w)  will  be  referred  to  as  elastic  data. 

In  practice  it  may  be  more  meaningful  to  subject  the  elastic  data 
to  upper  and  lower  bounds,  especially  when  p is  approximated  by  a simple 
form  (e.g.,  linear  or  piecewise  linear).  In  this  case,  v^(*)  can  be 
discontinuous  at  a point  if  one  of  the  elastic  datum  is  at  a bound  in 
all  optimal  solutions.  Now  discussing  the  improved  behavior  of  v^(») 
over  that  of  v(*)  is  more  difficult  — we  need  to  address  the  notions 
of  how  many  points  of  discontinuity  there  are  and  the  "size"  of  a dis- 
continuity (i.e.,  the  magnitude  of  a discrete  jump  in  optimal  value). 

If  an  upper  bound  were  placed  on  z in  example  problem  (7.5)  then 
the  plots  of  v^  in  Figure  7.2  could  possibly  display  some  discontinui- 
ties; however,  the  number  of  discontinuities  would  tend  to  be  fewer 
than  for  the  step  function  v(b)  and  the  sizes  of  such  discontinuities 
would  be  smaller  as  the  bounds  on  z (i.e.,  on  b)  are  made  looser.  For 
example,  v^(b)  with  r^  = 0.6  (r^  = 0 = z^)  remains  continuous  for  an 
upper  bound  of  5 on  z^  cind  is  discontinuous  only  at  b = 39  and  41  (with 
jumps  of  cubout  20)  for  an  upper  bound  of  3. 
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The  use  of  elastic  data  variables  (z,w)  to  represent  deviations  from 


goals  is  characteristic  of  goal  programming.  As  an  example,  federal 
funding  of  R & D projects  usually  involves  several  goals:  maximize  a 

measurable  return,  maximize  coverage  of  various  technological  areas, 
expend  the  availeible  annual  budgets,  maximize  personnel  involvements, 
etc.  The  selection/rejection  of  projects  corresponds  to  integer  0-1 
variables  and  funding  levels  correspond  to  continuous  variables.  This 
type  of  problem  could  be  <'ast  in  the  following  simple  goal  programming 
format : 


m 


/minimize  I u.(c.z.  - c.z.) 

I ..111  11 

z ' ,z  >0  1=1 


subject  to:  H^x  + H^y  + z"  - z" 


= b 


(7.7) 


(x,y)  c U 


where  U c ^ are  matrices  conformable  with  the  m-dimension- 

al  vector  b,  and  u^  is  a utility  or  priority  associated  with  a deviation 

frexn  the  goal  b,.  The  set  U accommodai  es  side  constraints. 

1 

The  optimal  value  function  v for  problem  (7.7)  is  continuous  with 
respect  to  all  data  (u,  c' , c",  H^,  , b)  . Thi'J  is  observed  immedi- 

ately from  Theorem  7.1.  Consequently,  as  wculd  be  hoped,  a goal  pro- 
gramming formulation  ^f  a mixed  integer  problem  assures  that  small  modi- 
fication of  the  goals  b ccinnot  result  in  an  incommensurate  change  in  the 
optimal  solution  value.  Moreover,  there  is  an  obvious  upper  bound  on 
the  optimal  value  v'  at  a perturbed  point  b':  writing  b'-b  as  s'-s" 

where  s'  ^ 0 and  s"  ^ 0,  we  have 

v'  < v + r.  u,(c.s.  - c.s.) 

— Ill  11 

where  v is  the  optimal  value  at  b (all  other  data  fixed).  Thus,  the 
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maximum  deviation  of  v*  from  v can  be  characterized  in  terms  of  the  de- 
viation of  b'  from  b. 

7.2  Relaxation  of  Integrality 

Consider  the  following  linear  (mixed)  quasi-binary  problem: 
n 

( maximize  I c.y. 

i-1  ^ ^ 


n 


(7.8) 


subject  to:  E a. ,y,  < b.  (j  = l,2,...,m) 

■ 1 ij  i “ D 
1=1 

y.  = 0 or  < y.  < u.  (i  = 1,2,. ..,n) 

^1  1—  1--1 

where  u ^ 1 and  0 _<  1.  This  is  a generalization  of  the  pure  integer 

problem  where  “ l,...,r»),  which  is  typical  in  investment 

planning  or  k & D project  selection. 

Intti preted  as  a model  of  R & D project  selection,  the  relaxed  in- 
tegrality constraints  of  (7.8)  provide  for  greater  realism  in  that  proj- 
ects can  be  accepted  at  variable  levels.  Consequently,  projects  with 
iin  functions  c^(y^)  such  as  those  depicted  in  Figures  7.3(a),  (b)  , 
and  (c)  can  be  accommodated;  the  level  of  acceptance  (amount  of  funding, 
ecc.)  of  a project  need  not  be  fixed.  This  appears  to  be  a much  more 
realistic  formulation  of  project  (or  portfolio)  selection  type  problems 
and  one  can  expect  that  it  possesses  much  more  favorable  continuity 
properties  than  does  the  counterj>a-t  pure  integer  problem.  There  is 
also  some  evidence,  which  we  will  discuss  shortly,  that  (7.8)  is  less 
difficult  to  solve  than  the  pure  integer  problem  (2.^  = u^  = 1 for  all  i), 
In  the  pure  integer  problem,  v(a)  , a H (c,a,b)  , is  continuous  at  a 

if  and  only  if  E a.  .y.  < b.,  (j  = l,...,m)  for  some  y that  is  optimal 
' ID  1 3 

at  a (Corollary  6.7,1).  It  is  typical  in  pure  integer  problems  that  an 
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split  into 
two  projects 


optimal  solution  y is  uniquely  optimal  (^uld  even  uniquely  e-optimal  for 
reasonably  small  e).  In  this  case,  v is  discontinuous  at  all  points  for 
which  equality  holds  in  any  one  of  the  constraints  (at  the  optimal  solu- 


tion) 


In  problem  (7.8),  however,  (assuming  i ^ u)  , v is  discontinuous  at 


a given  data  point  only  if  (at  every  optimal  solution)  equality  holds  in 


some  constrednt  j,  for  which  y^  = 0 or  (u^)  for  all  i such  that 


a^j  > 0 (a^j  < 0).  That  is,  v is  discontinuous  only  if  for  some  bind- 


ing constr£dnt  an  arbitrarily  small  reduction  in  the  right-side  would 


cause  all  optimal  y to  become  infeasible  (Theorem  6.7).  Although  v(b) 


generally  is  not  continuous  over  all  interesting  values  for  b,  points 


of  discontinuity  tend  to  be  fewer  in  manber  ^md  smaller  in  size  than 


for  the  counterpart  pure  integer  proulem.  This  is  illustrated  in 


Figure  7.4  for  example  problem  (7.2) 


Both  the  relaxed  problem  and  the  pure  integer  problem  are  repre- 


sented in  Figure  7.4:  the  step  function  is  the  optimal  value  function 


for  the  pure  integer  problem  (7.2),  and  the  much  smoother  function  -- 


which,  of  course,  dominates  the  step  function  — is  the  optimal  value 


for  the  quasi-integer  problem  where  y is  relaxed  by  ±10%)  i.e.,  y^  e 


{0,1}  in  (7.2)  is  replaced  by  y^  = 0 or  *9  ^ y^  ^ 1.1.  Only  one  dis- 


continuity occurs  for  the  quasi-integer  problem  (b  =»  72)  ; the  discrete 


jump  in  V is  approximately  12  units,  compared  with  a jump  of  60  in  the 


step  function  v (between  the  same  solution  points,  i.e.,  b = 80).  Again, 


for  the  case  where  there  are  several  constraints  and  b is  a vector,  two- 


dimensional plots  similar  to  Figure  7.4  are  possible  by  considering 


directional  changes  in  b;  however,  the  main  point  of  Figure  7.4  here  is 


relaxation  of  integrality* 


Figure  7.4.  Relaxation  of  Integrality  (+10%)  in  Problem  (7.2) 


t 
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to  illustrate  the  lir^irovement  in  continuity  properties  that  can  be 
achieved  by  allowing  integer  variables  to  be  quasi -integer. 

Armstrong  and  Sinha  [2]  describe  modifications  to  a branch-and- 
bound  algorithm  of  the  Beale  and  Tomlin  type  for  hamdling  quasi-integer 
problems.  They  report  that  the  modifications  are  minimal  and  no  appre- 
ciable increase  in  storage  is  needed.  The  algorithm  is  applied  to  a I 

I 

menu-planning  problem  and  computational  results  are  given  for  ten  prob-  I 

lems:  the  quasi-integer  problem  (+10%)  required  on  the  average  20% 

less  run  time  eind  over  40%  fewer  branches.  Petersen's  [isJ  investment  i 

( 

problems  were  also  studied:  the  quasi-integer  problem  (+10%)  required 

62%  fewer  branches  in  total  for  the  seven  problems.  (This  inprovement 
is  understand^dDie : LP  bounds  are  tighter  in  the  quasi-integer  case; 

one  would  expect  branching  to  reduce  as  the  allowedile  fluctuation  in  j 

» 

the  variables  is  increased.) 

7.3  Summary  amd  Conclusions  j 

! 

Two  general  notions  have  been  addressed.  The  first  is  that  simple 

I 

extensions  to  common  types  of  models  can  lead  to  greatly  improved  con-  j 

i 

tinuity  properties,  and  consequently,  more  realistic  and  bettei  behaved  j 

models.  Second,  such  added  sophistication  can  sometimes  actually  ma)te 
the  problem  easier  to  solve.  This  appears  to  be  the  case  with  relaxa- 
tion of  integrality  (auasi-integer  variables).  Vlhen  applic£d3le,  quasi- 
integer formulations  can  provide  greater  model  fidelity  cind  a reduced 
expense  in  obtaining  solutions?  sensitivity  of  v with  respect  to  data  is 
more  meaningful  and  easier  to  assess,  due  to  the  "smoothness"  of  the 
optimal  value. 

Replacing  data  by  variables  (data  releocation)  is  a technique  that 
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can  add  fidelity  to  the  modeli  this  results  in  improved  continuity 
properties.  In  particular,  replacing  right-side  resource  data  by  vari- 
ables results  in  an  optimal  value  function  that  is  continuous  with  res- 
pect to  all  data.  This  is  comforting  information  in  many  applications 
since  such  behavior  is  more  realistic,  and  secondly,  additional  sensi- 
tivity information  is  easier  to  obtain.  The  impact  of  this  technique 
on  problem  solution  time  has  not  been  investigated. 
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CHAPTER  8 


I, 
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h 
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INTROUUCTICW  TO  PART  II 

The  topic  of  continuity  amd  continuity  iunalysis  studied  in  Part  I 
addresses  the  qualitative  concerns  of  sensitivity  in  MIP  problems.  We 
now  turn  to  the  more  quantitative  eispects.  A primary  objective  is  to 
discover  data  perturbations  that  tcike  advemtage  of  discontinuities,  if 
any,  to  net  a substantial  improvement  in  the  optimal  value  v.  Of  parti- 
cular interest  are  techniques  for  bounding  and  approximating  v. 

8. 1 General  Considerations 

The  first  consideration  in  applying  amd  developing  methods  for 
sensitivity  analysis  is  to  identify  the  quamtity  aind  nature  of  informa- 
tion that  is  of  practical  use  to  the  analyst.  The  derived  information 
must  be  digestible  and  straightforward  to  interpret. 

A major  objective  in  studying  sensitivity  to  data,  especially  non- 
parametric  data,  is  to  discover  reasonable  data  perturbations  that 
result  in  substantial  improvements  in  optimal  value.  The  sensitivity 
information,  then,  consists  of  a set  of  ''alternative"  data  points, 
together  with  their  respective  improved  optimal  values  and  solutions 
(referred  to  as  alternative  solutions)  . One  approach  to  obtaining  this 
information  is  to  permit  the  data  to  fluctuate  from  the  nominal  for  a 
price.  This  requires  that  the  analyst  be  able  to  "cost  out"  the  economic 
(or  social,  environmental,  etc.)  consequences  of  perturbing  the  data. 

It  is  necessary  to  assvxne  that  there  exists  a criterion  for  pre- 
ferring one  alternative  solution  over  another.  In  some  cases  this  may 
be  difficult  to  quantify;  however,  it  is  rr.c«5t  likely  that  the  primary 
criterion  is  the  dollar  cost  of  aauitional  resources  required  for  the 
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alternative  solution.  An  alternative  solution  that  grants  an  improve- 
ment in  optimal  value  which  exceeds  the  consequential  costs  of  perturb- 
ing the  data  is  said  to  provide  a net  improvement. 

Some  flexibility  in  considering  nonquantiflable  preferences  is 
provided  by  generating  several  alternative  solutions  that  yield  net 
improvements  based  on  resource  costs  represented  ejqplicltly  in  the 
model.  The  analyst  may  subjectively  compare  alternatives  with  regard 
to  costs  that  aie  too  conplex  to  be  quwtified. 

Depending  on  the  nature  of  the  data,  reasonably  useful  information 
may  be  obtained  by  considering  only  directional  changes  in  the  data. 

If  p is  a direction  of  interest  in  perturbing  the  objective  function 
data  c,  then  one  cw  address  the  paraunetric  data  c+6p  where  6 is  a 
scalar  auid  p amd  c are  conformable.  Thus,  the  optimal  value  v is  a 
function  of  the  scalar  variable  0 amd  in  principle,  v(0)  could  be  plotted 
as  a two-dimensional  graph.  This  fxinctional  relationship  is  obviously 
much  easier  to  approximate  and  interpret  than  the  function  v(c)  where  c 
is  allowed  to  vary  arbitrarily.  In  general,  all  data  a could  be  param- 
etrized on  0;  the  parametric  relationship  a(0)  could  be  a nonlinear 
(but  continuous)  function. 

Sensitivity  to  data  that  might  be  perturbed  in  arbitrary  fashion, 
which  will  be  referred  to  as  "nonpareunetric  data,"  cannot  adequately  be 
represented  parametrically  in  the  sensitivity  analysis.  One  might 
imagine  obtaining  several  plots  of  v(0)  corresponding  to  different 
parametrizations , but  such  an  attempt  to  obtain  sufficient  information 
is  costly  and  presents  an  unwieldy  amount  of  material  to  digest.  In 
this  case,  a different  approach  must  be  tedcen. 
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Methods  for  deriving  sensitivities  to  the  several  types  of  problem 
data  — objective  function  data  (c)  , right-side  data  (b)  , and 
constraint  function  or  left-side  data  (a)  — are  necessarily  different 
because  the  optimal  value  behaves  differently.  The  optimal  value  v is 
continuous  with  respect  to  c but  is  generally  discontinuous  with  respect 
to  b emd  a. 

Simultemeous  fluctuation  of  all  data  is  not  given  serious  attention 
in  this  treatise  because  little  Ceui  be  gained  in  terms  of  sensitivity 
information  from  such  ein  analysis.  Allowing  perturbations  in  both  the 
left-side  cuid  the  right-side  data  would  produce  alternative  solutions 
that  could  also  result  from  perturbations  only  in  the  right-side  data. 
There  appears  to  be  little  need  to  study  effects  of  simulteuieous  changes 
in  a and  b.  Studying  the  combined  effects  of  perturbations  in  cost 
data  c and  right-side  data  b also  buys  little  additional  information 
because  sensitivities  to  b and  c to  a large  degree  are  incompatible: 
small  chcmges  in  c can  cause  only  small  changes  in  v,  whereas  small 
changes  in  b can  cause  discrete  jumps  in  v.  Generally  speaking,  then, 
it  is  likely  to  be  sufficient  to  limit  sensitivity  analyses  to  one  type 
of  data  at  a time  — right-side,  left-side,  or  objective  function  data. 

Analysis  of  left-side  data  is  a far  less  attractive  problem  for 
study  than  right-side  analysis,  for  several  reasons.  The  left-side 
data,  being  a two-dimensional  array,  is  comparatively  bulky;  its  simul- 
taneous and  arbitrary  perturbation  would  lead  to  an  overwhelming  amount 
of  information  that  is  neither  practical  to  obtain  nor  to  digest.  If  a 
particular  perturbation  of  the  left-side  data  admits  an  improved  solution, 
then  generally  there  is  an  infinite  number  of  alternative  perturbations 
that  will  admit  the  same  improved  solution.  Moreover,  there  must 


necessarily  be  a perturbation  of  right-side  data  alone  that  will  admit 
the  seune  solution,  suggesting  that  a search  for  alternative  improving 
solutions  can  be  carried  out  by  studying  only  the  right-side  data  instead 
of  all  constraint  data.  Let  us  illustrate  this  point.  The  constraint 

41yj^  + 39y2  + 20y^  + lOy^  £ 78  , 

for  example,  precludes  the  binary  solution  (1,1, 0,0).  This  solution 
would  be  feasible  if  b H 78  were  increased  to  80.  Alternatively,  the 
first  two  coefficients  could  be  reduced  respectively  from  41  and  39  to 
40  auid  38;  or  to  39,  39;  or  to  40.5,  37.5;  etc. 

s 

8.2  A Basic  Approach 

In  devising  a detciiled  approach  to  sensitivity  analysis  one  natur- 
ally seeks  to  obtain  the  desired  kind  and  amount  of  information  in  the 
computationally  least  expensive  way.  Two  situations  can  exist:  either 

attractive  alternative  solutions  exist,  or  they  do  not.  In  the  latter 
case,  the  fact  that  no  reasonable  data  perturbations  provide  a substein- 
tial  improvement  in  v(»)  hopefully  can  be  discovered  relatively  easily, 
thereby  alleviating  the  need  for  any  further  analysis.  In  the  former 
case,  the  discovery  of  alternative  solutions  requires  and  merits  a more 
extensive  computational  effort. 

We  recommend  approaching  sensitivity  analysis  via  the  following 
basic  steps: 

(1)  Determine  bounds  on  the  improvement  possible  due  to  reason- 
able data  perturbations;  stop  if  the  potential  improvement  is 
small . 

(2)  Attempt  to  derive  alternative  solutions  that  provide  substaui- 
tial  improvements  in  optimal  value. 
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(3)  Analyze  amd  compare  the  alternative  solutions  in  order  to 

arrive  at  a decision  concerning  which  to  implement  or,  possi- 
bly, concerning  needed  modifications  to  the  model. 

Steps  (1)  and  (2)  are  addressed  in  detail  in  later  chapters;  step 

*/ 

(3),  however,  is  itself  a vast  subject  for  study-*  and  is  beyond  the 
scope  of  this  treatise. 

This  approach  applies  primarily  to  the  cinalysis  of  data  that  poten- 
tially give  rise  to  discontinuity  in  v (e.g.,  b)  . In  cases  where  the 
data  perturbations  of  interest  permit  a continuous  and  tractable  optimal 
value  function  (e.g.,  parametric  cost  data),  an  approximation  or  v(*) 
may  be  a ’'easonadile  objective. 


8 . 3 Content  and  Summary 

Sensitivity  to  objective  function  data  c is  studied  in  Chapter  9. 

The  optimal  value  is  a concave  function  of  the  data  c.  In  the  linear 
parametric  case,  v as  a function  of  0 is  piecewise-linear  cind  concave 
and  therefore  can  be  expressed  as  the  pointwise  minimum  of  finitely  many 
linear  functions.  The  concavity  property  permits  straightforward  approx- 
imation of  V by  quite  simple  bounding  techniques.  The  content  of  Chap- 
ter 9 is  summarial  in  nature  and  consists  mostly  of  evident  corollaries 
of  the  concavity  property. 

Methods  for  right-side  analysis  derive  primarily  from  a few  basic 
concepts  and  techniques;  these  are  presented  in  Chapter  10,  Lower  bounds 
on  V are  prcvided  from  solutions  to  relaxed  versions  of  the  MIP  problem; 
upper  bounds  derive  from  feasibility  and  monotonicity  properties. 

Alternative  methods  of  right-side  analysis  are  studied  in  Chapter 

*1 

— * Comparison  of  alternative  solutions  could  involve  considerations 
that  are  nonquantif iable  and/or  too  complex  for  explicit  expression  in 
the  model. 
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11.  Two  methods,  in  particular,  are  emphasized:  "rounding"  of  a non- 

integer solution  obtained  from  a relaxation  (of  the  domain)  of  the  MIP, 
and  relaxing  the  right-side  data  b by  treating  b as  variable.  A class 
of  MIP  problems  is  identified  for  which  rounding  of  a solution  to  the 
continuous-variable  relaxation,  obtained  by  dropping  integrality  restric 
tions  on  the  integer  variables,  always  yields  a solution  that  is  optimal 
in  the  MIP  at  some  perturbed  right-side  b'. 

The  second  approach  involves  replacing  b by  b+z  where  z is  variable 
cind  incurs  a penalty  p(z).  A solution  to  this  problem  produces  an  alter 
native  solution  to  the  MIP  (i.e.,  a solution  that  is  optimal  at  a per- 
turbed right-side  b').  A collection  of  alternative  solutions  Ccin  be 
generated  by  varying  the  penalty  p(*). 

8.4  Notation 

The  bounded  mixed  integer  program  in  its  most  general  form  is 
given  by 

minimize  f(c;x,y) 
xcX.ytY 

subject  to:  (x,y)  e F(a) 

where  X is  compact,  Y is  a finite  set,  and  F(a)  is  closed.  The  data  c 
and  a (or  c,  a,  amd  b if  right-side  data  are  introduced)  are  identified 
with  a;  the  optimal  value  function  will  be  expressed  as  v(a)  . The 
notation  v(c)  will  denote  v(c,a)  where  a is  considered  fixed;  similarly, 
v(a)  H v(c,a)  where  c is  held  fixed. 

For  (linear)  parametric  objective  function  data  we  define 

v{0)  : minimum  f(c+Gp;x,y)  | (x,y)  c F(a)  (8.2) 

xf.X,yEY 

where  c,  p and  a are  fixed.  The  same  notation,  v(0),  will  be  used  in 
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dealing  with  parametric  right-side  data  euid  will  therefore  need  to  be 
read  in  context. 

The  notation  v (•)  will  denote  the  optimal  value  of  the  continuous- 

y 

variable  subproblem  that  results  when  y is  held  fixed. 

The  c-optimal  solution  set  corresponding  to  v(a)  is: 

M^(a)  H { (x,y)  e X X y|(x,y)  is  e-optimal  at  a}  . (8.3) 

For  e = 0 we  will  simply  write  M(a).  The  set  M(6)  corresponds  similarly 
to  v{0),  M(c)  to  v(c),  etc. 

The  variables  (x,y)  will  frequently  be  written  as  a partitioned 

X 

column  vector  ■ Gradients  will  always  be  regarded  as  column  vectors. 
The  notation  ^ example,  denotes  the  gradient  of  f(c,*x,y)  with 
respect  to  c.  All  vectors  of  data  are  row  vectors. 

Vectors  are  denoted  by  lower  case  letters  and  matrices  by  upper 
case  letters.  A "bar"  above  a data  symbol,  e.g.,  b,  denotes  data  that 
are  held  fixed  while  other  data  are  treated  as  parameters. 
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CHAPTER  9 

SENSITIVITY  TO  OBJECTIVE  FUNCTION  DATA 

Fluctuations  in  objective  function  data  c^ulnot  result  in  a discrete 
jump  in  the  optimal  value.  The  sensitivity  issue  of  relevance  here  is 
"how  much"  or  "at  what  rate"  can  the  optimal  value  change  due  to  cost 
data  changes.  Although  it  is  conceivable  that  this  rate  of  change  may 
be  high,  it  is  not  typical  that  a small  chemge  in  the  "cost"  data  will 
result  in  a disproportionate  chemge  in  optimal  value. 

Studying  the  sensitivity  of  v to  cost  data  c consists  of  bounding 
and  approximating  v(c)  over  the  range  of  values  c of  interest.  An  effec- 
tive approach  to  approximating  v(c)  is  to  consider  parametric  cost  data 
and  address  v in  terms  of  the  scalar  parameter  6. 

Procedures  for  solving  linear  problems  pareunetric  in  the  cost  data 
are  by  now  well  documented.  Noltemeier  [13]  presents  basic  properties 
and  schema;  a procedure  in  the  context  of  parametric  programming  is 
described  emd  computational  results  reported  in  the  recent  thesis  by 
Nauss  [12] . 

The  intent  here  is  to  bring  together  the  major  facts  already  known 
about  the  behavior  of  v with  respect  to  c emd  to  show  how  these  derive 
easily  from  a few  fundamental  properties.  The  optimization  problem  is 
given  as: 

minimize  f(c;x,y)  . (9,1) 

(x,y)eF 

A fundamental  property  of  this  problem  is  that  fluctuations  in  the  data 
c do  not  affect  feasibility  of  a solution  (x,y) . 

This  observation  suggests  that  the  behavior  of  v(c)  is  founded  on 
that  of  f with  respect  to  c.  First,  the  following  upper  bound  is 


\ 
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immediate: 


v(c)  < f (c;x,y) 


(9.2) 


for  ^my  (x,y)  e F.  Second,  v(c)  is  monotone  nondecreasing  in  c if  f is 
monotone  nondecreasing  in  c for  each  (x,y)  e F.  Third,  v(c)  is  contin- 
uous and  concave  (cf.  Theorem  5.4)  — the  only  requirement  for  concavity 

*/ 

is  that  f likewise  be  concave  in  c for  (x,y)eF  fixed.-'  Thus,  continuity 
euid  concavity  of  v hold  even  when  f is  discontinuous  with  respect  tc 
(x,y).  Moreover,  there  is  no  requirement  that  F be  a subset  of  a vector 
space:  for  instance,  y may  repress  it  a combinatorial  object  such  as  a 
map  of  one  finite  set  into  another. 

The  bound  (9.2)  leads  to  cmother  property  of  the  nonlinear,  possibly 
discrete  problem  (9.1),  a property  that  is  familiar  in  the  context  of 
LP  problems.  Suppose  that  the  objective  function  is  given  by 


f(c;x,y)  r I c^h^(x,y) 


(9.3) 


where  h^(x,y)  ^0  for  all  (x,y)  e F so  that  v(c)  is  monotone  nondecreas- 


ing. Define  also 


h,  = min  h.(x,y),  h.  - max  h. (x,y) 
F F 


(9.4) 


and  let  (x*,y*)  denote  an  optimal  solution  in  problem  (9.1). 


Theorem  9.1;  Let  c'  be  any  cost  vector  satisfying 


^i  ^ 


< c . , if  h , (x* ,y*)  = h . 
— 1 1 1 


> c.  , if  h. (x*,y*)  = h. 
— 1 1 — 1 


= c^ , otherwise 


V 


— Concavity  of  f in  c generally  precludes  exponential  data  in  the  forms 


c , x*^,  e*^^  and  log  cx;  however,  many  practical  objective  functions  a?  e 

X-i 


concave  ^linear,  in  fact)  in  the  data:  polynomials  on  X x Y,  Ic^e 

T.  In(Xj^)  piecewise-linear  concave  functionals,  etc. 
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Then  (x*,y*)  is  optimal  at  c'. 


Proof:  Define 


if  h^(x*,y*)  - ^ 
c^,  otherwise  . 


Without  loss  of  generality  assume  that  h ••  0 (i.e.,  translate: 
h'  ■ h-li) . Then  v(c")  ^ v(c)  - f(c»x*,y*)  ■ f(c";x*,y*)  ^ (x*,y*) 
optimal  at  c".  Now  ^ if  h^(x*,y*)  ■ h^  aund  otherwise. 

Tramslate:  h'  = h-h  £0  [-t>  v(c')  ^v(c")].  Then  f(c';x*,y*)  - 

f(c";x*,y*)  - v(c")  ^v(c')  (x*,y*)  optimal  at  c*. 


In  the  special  case  where  (9.1)  is  a linear  MIP  problem,  the  bounds 
(9.4)  correspond  to  lower  and  upper  bounds  on  the  variables.  Nauss  [12] 
shows  for  the  linear  0-1  MIP  case  that  c’  can  be  allowed  even  greater 
freedom  when  varying  only  one  component  at  a time. 

A fundamental  property  of  (9.1)  in  the  linear  case  is  that 

min  c(’')  = min  c(*^)  (9.5) 

F ^ Co(F)  ^ 

where,  of  course,  the  latter  is  an  LP  problem.  It  follows  that  v(c)  is 
piecewise-linear  emd  concave,  just  as  in  the  LP  case  (Manne  [11], 
Noltemeier  [13]).  If  F is  bounded,  v(c)  consists  of  a finite  number  of 
linear  "pieces,"  c e E^. 

Consider  pareunetric  costs  c+9p.  The  concavity  property  permits  a 
straightforward  procedure  for  approximating  v(9)  [cf.  (8.2)].  Assuming 
that  f is  differentiable  with  respect  to  c in  direction  p at  c+S^p,  the 
bound  (9.2)  ccin  be  written  as 

v(9)  < L„(9)  e v(0„)  + (0-9^)p.7  f(c;x,y)  (9.6) 

— 0 0 0 c 

where  (x,y)  is  optimal  at  9 . The  product  p'V  f represents  the  slope  of 

w O 


the  linear  upper  bound.  In  the  linear  case  (9.6)  Is  simply  v(6)  £ 

(c+eF)  . 

Concavity  also  provides  a means  for  lover-bounding:  for  any  0 

satisfying  ® ^2  ®2' 


v(0)  ^ L(0)  = v(0j^)  + (0-0^) 


O(02)-v(0^) 

0 -0 
? 1 


(9.7) 


By  solving  at  the  valuers  0^^  and  0^  one  obtains  the  bounds  depicted  in 
Figure  9.1.  The  shaded  region  represents  uncertainty  in  the  true  graph 
of  v(0).  The  concavity  of  v(*)  assures  that  v(0)  does  not  behave  wildly 
within  the  region  of  uncertainty:  the  rate  of  chauige  (slope)  of  v(0), 

0^  0 ^ 02»  is  bounded  by  the  slopes  of  L^(0)  ^u^d  L2(0). 

At  obvious  procedure  for  reaucing  this  uncertainty  to  an  acceptable 
size  is  to  resolve  at  an  intermediate  point  such  as  0^,  the  point  of 
intersection  of  L^(0)  and  introduces  another  upper  bound 

and  replaces  the  lower-bounding  segment  by  two  lower-bounding  seqr.>ents 
as  shown  in  Figure  9.2. 

Any  procedure  for  approximating  a concave  function  can  be  applied 
to  v(0).  A flexible  ^^rocedure  is  offered  in  Appendix  9A  that  derives 
piecewise-linear  concave  functions  V(0)  emd  v(0)  cn  [0,1]  satisfying 


V(9)  > v(0)  > v(0) 


V(0)  - v(0)  < e 


for  any  prescribed  c > 0. 


appi;ndix  oa 


A gi:ni;ral  procedure  for  approximating  v(o) 

A basic  procedure  is  described  that  applies  in  general  to  nonlinear 
MIP  problems  paraunetric  in  the  cost  data.  This  procedure  specializes 
easily  to  the  linear  case. 

Let  e > 0 denote  a specified  maximum  allowable  tolerance  between 
v(6)  cmd  its  approximation.  The  procedure  will  produce  concave  piece- 
wise  linear  functions  V(0)  and  v(0)  satisfying 


and 


V(0)  ^ v(0)  ^ v{0) 
V(0)  - v(0)  < e 


(9A.1) 


for  all  0 c [0,1]  . 

The  maximum  pointwise  error  in  the  estimate  of  v{*)  between  0^  and 
0^  is  given  by  the  maximum  difference  between  the  upper  bounds  and  the 
lower  bound.  This  maximum  difference,  which  will  be  denoted  by  h, 
occurs  at  the  point  0^  where  the  upper  bounds  L^(0)  and  L^O)  intersect. 
Define  H L^(9j)  = Thus, 


h = - L(0j) 


(9A.2) 


where  0^  is  obtained  by  solving  Lj^(O)  = ^2^®^ 

If  h < c,  then  v(0)  is  sufficiently  well  approximated  by 


V(0)  = < 


L^(0)  , 0 e 
L2(0),  0 c 19^,02] 


and 


v(0)  = L(0),  0 e te^,02]  . 


(Initially,  0^  = 0 and  02  -1.)  Ifh>e,  solve  the  MIP  problem 
at  0^.  This  yields  v(6^)  cind  the  linear  support  at  0^: 
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L(0)  - v(6j)  + (0-0j)b 


(9A.3) 


where  s = p*V  f (c+0,p;x,  ,y,)  and  (x^,y^)  is  optimal  at  0_.  The  supports 
c I I I II  I 


L^(0)  and  L2(0)  can  be  expressed  as 


L^O)  = Vj  + (0-0j)9j^ 


L2(0)  = Vj  + {0-0j)S2 


(9A.4) 


where  s^^  and  are  the  slopes  given  by 


s = p*V  f (c+0  p;  X ,y  ) 
i c 111 


’ P*^(,^<c+02P;  ■ 

These  linear  supports  are  depicted  in  Figure  9A.1.  The  svpports 
Lj^(0)  and  L(0)  intersect  at  0^;  ^2^®^  intersect  at  0^.  Two 
new  lower-boinding  line  segments  are  generated.  These  are  given  by 


v(0^)-L^(0^) 


L (0)  H v(0j)  + (0-0j)  • 0 e ^®1'®I^ 


L (0  )-v(0  ) 

l’^(0)  = v(0j)  + (0-0j)  Q -e"~  ' ^ ^ ^®I'®2^ 


(9A.5) 


The  maximum  errors  at  0^^^  and  9^  are  given,  respectively,  by 


= i{Q^)  - h h^  = L{0^)  - L (0^)  . 


(9A.6) 


If  s,  = s,  then  h„  =0.  If  s > s (note  that  s,  > s > s„) , then 
1 H 1 1 — — 2 

it  can  be  shown  from  (9A.3)  through  (9A.6)  (or  by  observation  from 


Figure  9A.1)  that 
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emd 


V -v(e  ) 

0 - 0T s — 

I I 8,-9 


Similarly,  if  = S,  then  = 0,  and  if  82  < s»  then 


Vi-v(0i) 

0 = 0T  + — T~Z 

r I s-s_ 


V 


Figure  9A.1.  The  Approximation  Procedure 


r 
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The  intersection  point  of  two  lypper-bounding  supports  identifies 

what  will  be  referred  to  as  a candidate  problem  (CP).  Ihus,  6.  and  6 

I r 

identify  two  candidate  problems.  Notice  that  h^,  h^  euid  0^,  0^  are  ex- 
pressed in  terms  of  0^,  V^,  s^^,  s^,  0^^  £md  02*  Consequently,  a CP  can 
be  defined  in  terms  of  these  six  quantities  and  will  be  denoted  by 

CP  I ( 0 , V,  ^2^  ^1^  ^2^  * 

If  h^  £ e#  then  v(*)  is  sufficiently  well  approximated  on  [0j^,0j,]. 
If  hj^  ^ e»  however,  then  the  MIP  problem  to  be  solved  at  0^  is  defined 


by 


CP J * ^1*  ^1^  ^I^  * 


Similarly,  v(*)  is  sufficiently  well  approximated  on 
hp  > E gives  rise  to  the  candidate  problem 

CP:  (0J..  L(0^)  , s,  s^,  0jr  62)  . 

It  is  easily  shown  that 


s v(0  )-sV  sV  -s  v(0  ) 

V = -Tii:; — 


(9A.9) 


The  procedure  requires  maintaining  a list  of  candidate  problems. 
Each  time  a CP  is  solved,  this  list  is  reduced  by  one  and  increased  by 
zero,  one,  or  two  additional  entries.  The  solution  of  each  CP  yields  a 
point  (0,v(0));  each  time  the  error  h^  at  an  intersection  point  0^ 
(i.e.,  0^  or  0^)  is  less  them  or  equal  to  e,  the  information 
gives  acceptable  estimates  of  v(*)  at  0^  and  the  maximum  error  in  these 
estimates  — specifically, 


V(0j)  = Vj  ^ v(0^)  ^ V^-hj  = v(0j) 
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The  procedure  Is  described  as  follows : 

(1)  Solve  for  v(0)  2uid  v(l)  and  output  the  points  (0,v(0))  , 

(l,v(D).  Compute  h given  by  (9A.2)  . If  h £ e,  output 
(0j#Vj,h)  and  STOP. 

(2)  Solve  at  0^  and  output  (0j,v(0j)).  Coitputo  h^  amd  h^  (at  0^ 

and  0^,  respectively)  from  (9A.7)  and  (9A.8).  If  h^^  £ z, 
output  (0^,L(0^)  ,h^)  ) i.e.,  V(0j^)  - ^ enter 

CP;  (0^,L(0^)  ,8j^,8,0^,0j)  into  the  CP  list.  If  h^  £ z,  output 
(0  ,L(0  ) ,h  ) ; if  h > e,  enter  CP: (0  ,L(0  )»s,s_,0  ,0  ) into 

ITITIT  IT  iriTfcX^ 

the  CP  list. 

(3)  If  the  CP  list  is  empty,  STOP.  Otherwise,  select  a 

^^l''^l'^l'^2'®l'®2^  from  the  list  and  go  to  (2). 

The  procedure  provides  two  sets  of  points  which  we  will  refer  to  as 
Sj^  and  S2*  The  set  S^  contains  points  of  the  fonn  (0,v(0))  obtained  by 
solving  the  candidate  problems.  At  these  values  of  0,  V(0)  = v(0)  = 
v(0) . The  set  S^  contains  points  of  the  form  (0,V(0))  obtained  by  ob- 
serving an  acceptable  error  at  points  of  intersection  of  linear  supports. 

The  lower-bounding  function  v(0)  is  obtained  by  linear  interpolation 
between  adjacent  points  of  S^  (ordered  by  increasing  values  of  0)  ; 
similarly,  V(0)  is  obtciined  by  linear  interpolation  between  adjacent 
points  of  [I  S^. 

These  functions  are  illustrated  in  Figure  9A.2  with  = {(0,Vq), 

(02»V2)  , (l,v^)  } and  = { (O^jV^)  , (0^,v^)  }.  Associated  with  each  point 
in  is  the  computed  maximum  error;  these  are  indicated  as  h^  and  h^ 

(h^  £ e . _<  g)  . 


} 
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V(0) 


Figure  9A.2.  Illustration  of  the  Bounding  Functions  V and  v 

The  procedure  can  be  enh2tnced  by  using  feasible  solutions  generated 
in  the  course  of  solving  a CP  to  define  adr!itional  CPs.  For  instance, 
solving  at  0 = 0 in  step  (1)  produces  feasible  solutions  that  are  not 
optimal  at  0 = 0 but  are  possibly  optimal  at  other  values  of  0.  Taking 
the  pointwise  minimum  of  the  upper  bounds  associated  with  these  solu- 
tions defines  additional  CPs.  Evidently,  it  is  possible  in  the  linear 
case  that  this  feature  could  derive  v(0)  after  solving  N+2  problems 
where  N is  the  number  of  break  points  (at  least  this  many  are  required 
to  derive  v(0) ) . 

The  proof  of  finite  'onvergence  requires  establishing  that  the 
maximum  errors  generated  by  a chain  of  successive  CPs  tend  toward  zero. 

A proof  is  given  later.  The  rate  of  convergence  depends,  of 
course,  on  the  tolerance  e emd  the  degree  of  nonlinearity  of  v(0).  It  is 
worth  mentioning  that  in  practice  c should  be  chosen  larger  than  ciny 
toleramce  on  optimal  (i.e.,  near-optimal)  solution  values;  (the  linear 
supports,  0j,  Vj , and  nMucimvm  errors  h can  be  no  more  accurate  than  the 
solutions  from  v^ich  they  are  determined)  . 


■ Wf  yi,i  ■'■I'.  W*-  V>  'I  fywi'lj"  nv,fiinn|>»i<iii 


For  linear  MIP  problems  v(0)  is  known  to  be  piecewise  linear  (and 
concave) . The  approximation  procedure  can  be  enhanced  by  exploiting 
piecewise  linearity.  Each  of  the  finitely-m£my  breedc  points  of  v(0)  is 
an  intersection  point  of  two  upper  bounding  linear  supports.  Since  the 
approximation  procedure  selects  such  intersection  points  to  define  suc- 
cessive candidate  prcblems,  the  procedure  with  e * 0 would  (in  theory) 
eventually  discover  all  break  points  emd  thereby  produce  v(6) . Thus, 
finite  convergence  is  evident  for  all  c 0. 

Two  improvements,  in  particular,  can  be  made  in  the  approximation 
procedure  when  applied  to  linear  MIP  problems  pareunetric  in  the  cost 
data.  Given  CP : (0^ , ,s^^ ,S2 ,0^^,  02)  » if  v(0^)  = “ 

L(0),  for  all  0 e (0j^,02l-  It  can  be  shown  that  L(0^)  can  be  expressed 
in  terms  of  the  six  available  quantities  as  follows; 

(0  -6.) 

U6j)  - . (9A.X0) 

Secondly,  if  v(0j)  = , then  0^  is  a break  point  and  v(0)  = min{Lj^(0), 

L2(0)}  on  [0j^,02];  this  CP  is  then  "fathomed"  in  the  sense  that  no 
di.S'vundant  CPs  need  be  generated. 

In  practice,  v(0^)  would  be  tested  for  approximate  equality  to 
or  ^(0j)  v(0j)  ; Vj  or  v(0^)  : provide  for  a computa- 

tional tolerance  on  optimality  and  the  propagation  thereof  in  the  com- 
putation of  and  L(6j)  . Notice  that  if  v(0j.)  is  within  e of  V^. , then 
the  CP  is  fathomed  since  the  procedure  will  find  that  h^  < e and  h^  < e. 

These  tests  can  be  implemented  in  step  (2)  of  the  procedure  before 

h„  and  h are  computed.  If  either  v(0^)  = or  v(0  ) ; L(0,),  then 
I r II  I—  I 

output  the  point  (0j.,v(0j))  cind  go  to  step  (3)  — the  current  CP  is 
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fathomed. 


2; 


Theorem  9A.1;  Suppose  that  the  MIP  problem  is  linear;  let  N (N  ^ 1) 
denote  the  number  of  break  points  in  (0,1].  Then  the  procedure  con- 
verges after  solving  no  more  than  2N+1  problems  (including  0*0  and 
0 = 1),  for  euiy  e ^ 0. 

Proof ! There  are  N+1  linear  segments  on  the  graph  of  v(6)  , e e [0,1]. 
Suppose  0j  is  not  a break  point;  let  adjacent  breedc 

points  which  identify  the  linear  segment  on  which  (0j,v(0))  lies.  This 
linear  segment  coincides  with  the  linear  support  L(e)  generated  by  the 
solution  at  0^.  Consequently,  any  other  (upper-bounding)  si^jport  cannot 
intersect  L(0)  at  a point  0 c (0^,02).  Therefore,  no  more  than  one 
problem  will  be  solved  for  each  of  the  N+1  segments.  Solving  at  each 
of  the  N break  points  thus  yields  a maximum  total  of  2N+1  problems.  I I 


We  now  give  a proof  of  finite  convergence  for  the  nonlinear  case. 


1/ 


The  solution  of  the  first  CP  (candidate  problem)  gives  rise  to  two 

more  "second  generation"  CPs.  An  n*”^  generation  CP  results  from  solv- 

th 

ing  n-1  predecessor  CPs  and  cem  itself  father  zero,  one,  or  two  (n+1) 
generation  CPs.  Let  {(CP)*^}  denote  a sequence  of  CPs  where  (CP)*^  is  of 
the  n^^  generation,  and  let  h*^  be  the  computed  maximum  error  correspond- 
ing to  (CP)*^.  The  problem  (CP)*^  is  identified  by 


,„n  ,n  n n ^n  _n 
(CP)  : (0  , V , s^,  s^*  0j^  f ©2)  ■ 


Also,  let  Sq  denote  the  slope  of  the  lower  bound  for  (CP)^. 

_ 

— Noltemeier  [13]  gives  an  approximation  approach  similar  to  the  one 
described  here  and  a tedious  proof  of  convergence  (no  bound  is  given 
on  the  number  of  problems  that  must  be  solved)  . The  procedure  des- 
cribed here  tcikes  advantage  of  the  slope  generated  at  0^  to  impose  an 
improved  upper  bound  (this  bound  also  determines  the  descendeuit  CPs) 
and  the  proof  of  convergence  is  relatively  easy. 


Lenma  1»  The  sequence  {h"}  converges  monotonically . 

Proof;  For  all  n,  h ^ ^ 0 where  h is  computed  in  step  (1)  — see 

Figure  9A.1.  Also,  h*^  ^ (by  observing  similar  triangles  in  Figure 

9A.1)  . Boundedness  and  monotonicity  imply  convergence.  || 

Let  h = lim  h"^.  If  for  some  n,  h"^  * 0,  then  {(CP)*'}  is  a finite 
n-H» 

n 

sequence  and  n ■ 0.  Suppose  on  the  other  hand  that  h >0  for  all  n. 
Define  p**  = V*'-v(0*')  and  q*'  E h*'-p*'.  These  quantities  are  illustrated 
in  Figure  9A.3. 


Figure  9A.3.  Illustration  of  Descriptive  Quantities  for  (CP) 


Lemma  2 : h ->  0 . 


^ c i.n+1  n _ , n n ,n  , 

Proof:  Since  h£h  <p  = h-q  <h,we  have 


h = lim  = lim  h*'  - lim  q*'  = h - lim  q*'  < h 


so  that  q*'  -*■  0.  This  in  turn  implies  that  |s*'^^-Sq|  0 (these  slopes 

are  bounded  by  the  finite  slopes  s^^  and  s^)  • Also, 
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0 < h"*‘  < 

— — max  0 


< s 


n+1  ni  - 
-9^1  ■>  0 . 


Theorem  9A.2;  The  approximation  procedure  (e  > 0)  converges  in  a finite 
nundser  of  steps. 


Proof : For  any  chain  { (CP)^},  h*'  0.  Hence,  3 N^h^^^eyn^N. 


The  result  follows  since  each  chain  is  terminated  after  a finite  number 
of  generations,  thereby  permitting  only  a finite  number  of  chains. 
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CHAPTER  10 

RIGHT-SIDE  ANALYSIS:  BASIC  CONCEPTS  AND  PROPERTIES 

Methods  for  determining  the  behavior  of  the  optimal  value  v with 
respect  to  variations  in  right-side  (RS)  data  derive  from  a handful  of 
basic  concepts  and  properties.  Fundamental  are  the  restriction  aid 
relaxation  concepts  which  provide  upper  and  lower  bounds  (respective- 
ly) on  V.  The  judicious  ccxnbination  of  these  upper  and  lower  bounds 
provides  a means  for  amalyzing  the  behavior  of  v as  a function  of  RS 
data. 

Much  of  the  development  of  this  chapter  makes  use  of  recent  works 
by  Geoffrion  [4,5,6]  and  some  familiarity  with  these  will  be  helpful. 
The  material  is  presented  in  the  context  of  nonparametric  RS  analysis , 
but  is  easily  specialized  to  the  parametric  case  (b+0r)  . 


10.1  The  Analysis  Problem 

We  address  here  the  function  v(b)  defined  as  the  optimal  value  of 
the  MIP  problem 


(P)  I 


Minimize  f(c;x,y) 
(x,y)eU 

subject  to:  G(a;x,y) 


^ b 


where  it  is  assumed  that  the  data  c and  a are  fixed,  b e E*",  and 
U = C n (X  X Y)  where  X is  compact  in  (x  e E*^)  , Y is  a finite  set  in 
(y  E E^)  , cuid  C is  a closed  set  in  The  (compact)  feasible 

region  { (x,y)  e u|G(a;x,y)  ^ b}  will  be  denoted  by  F(b).  The  set  of 
right-sides  for  which  (P)  is  feasible  is  denoted  by  B;  v(b)  E »>  if 


b if  B. 


146 


It  is  assumed  also  that  f Is  continuous  on  c x X @ Y,  G Is  continu- 
ous on  a X X @ Y,  and  []  0.  To  simplify  notation  slightly,  f(c>x,y) 

and  G(a;x,y)  henceforth  will  be  written  as  f(x,y)  and  G(x,y). 

Formulation  (P)  suggests  a partitioning  of  the  problem  constraints 
into  two  sets:  those  with  right-sides  that  are  not  permitted  to  be 

perturbed  (represented  by  the  set  U)  and  those  with  right-side  b whose 
influence  on  v is  to  be  investigated.  Each  of  these  sets  may  include 
equality  as  well  as  inequality  constraints. 

A 

The  einalysis  problem  is  to  determine  right-sides  b that  are  accept- 


ably "close"  to  the  nominal  b and  which  gremt  (net)  improvements  in 


optimal  value;  (an  optimal  solution  at  such  a point  b is  referred  to  as 
an  alternative  solution  to  (P)).  With  par2unetric  RS,  b+6r,  an  additional 
objective  may  be  to  derive  or  approximate  v(0)  . 

10.2  Restriction  emd  Upper  Bounding 

The  term  restriction  is  used  in  the  following  sense:  a minimiza- 

tion problem  (Q)  is  said  to  be  a restriction  of  (P)  if  for  all  b e B 
the  feasible  region  F(b)  of  (P)  contains  that  of  (Q)  and  the  objective 
function  of  (Q)  is  nowhere  less  than  f(*,*)  on  F(b).  The  idea  of  upper 
bounding  by  restriction  is  a familiar  one  and  is  briefly  reviewed  here 
in  the  context  of  right-side  analysis. 

Restricting  any  subset  of  the  varicdjles  (x,y)  to  fixed  feasible 
values  leads  to  an  upper  bound  on  v(b) . In  particular,  when  the  dis- 
crete variables  are  held  fixed  at  a y e Y,  one  has 


v(b)  ^v^(b),  (y  e Y,  b e E ) . 


(10.1) 


The  problem  (P^)  obtcdned  by  fixing  y in  (P)  is  a continuous-variable 
problem.  When  C is  a convex  set  and  f and  G are  convex  in  x,  v^(*)  is 
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also  convex. 

A natural  choice  of  y in  (10.1)  is  a y*  that  Is  optimal  at  b In  (P) ; 
thus,  equality  holds  in  (10.1)  at  b » b and  it  Is  reasoneOsle  to  expect 
that  equality  holds  on  a larger  subset  of  B.  This  conjecture  is  intui- 
tive from  the  fuct  that 


v(b)  ■ min{v  (b)},  b e B 
yeY  y 


(10.2) 


£U»d  that  B can  be  partitioned  into  a finite  number  of  subsets  on  each  of 
vrtiich  v(*)  ■ fot'  some  y c Y.  The  following  properties  suggest 

that  V *(•)  is  a reliedile  indicator  of  the  local  behavior  of  v(*). 


(1)  For  any  e > 0 there  is  a Ab  > 0 such  that 


v .(b)-e  < v(b)  < v .(b),  for  b < b < b+Ab 

y*  _ - y*  - - 


(10.3) 


(2)  If  y*  is  strongly  feasible  (this  precludes  equality  constraints 
in  G(x,y)  £ b;  cf.  §4.3),  then  for  any  e > 0 there  exists  a 
Ab*  > 0 such  that 

v *(b)  -e  < v(b)  < V *(b),  for  b-Ab'  < b < b+Ab'  . (10.4) 

yW  — — y*  — — 

(3)  If  y*  is  uniquely  optimal  at  b,  then: 

(a)  there  exists  a Ab  > 0 such  that 


v(b)  =•  V (b)  for  b < b < b+Ab  ; 

y ~ 


(10.5) 


(b)  if  in  addition  y*  is  strongly  feasible  at  b (all  con- 
straints G(x,y)  £ b must  be  inequalities)  , then  there 


exists  a Ab'  >0  such  that 


v(b)  = V .(b)  for  b-Ab'  < b < b+Ab'  . 

y*  “ “ 


(10.6* 


Property  (1)  derives  easily  from  lower-semicontinuity  of  v emd 
continuity  of  The  choice  of  b assures  that  y*  is  feasible  in  (P) 

Strong  feasibility  assures  that  y*  is  feasible  in  a neighborhood  of  b. 
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thus  property  (2)  results  as  a simple  extension  of  (1). 

A detailed  proof  of  property  (3)  is  given  in  Appendix  lOA  along 
with  a brief  discussion  on  the  use  of  dual  variable  interpretations  in 
appr:)xiinating  local  behavior.  Under  the  hypotheses  of  property  (3) , 
the  MIP  problem  (P)  locally  reduces  to  a contlnuous-varisJsle  problem; 
the  usual  interpretation  of  optimal  duzds  corresponding  to  b in  problem 
(P  J is  equally  valid  when  applied  to  (P)  . Unfortunately,  the  size  of 

y 

the  neig'nborhood  of  b on  vdiich  v and  v^^  coincide  is  not  known.  These 
remarks  hold,  of  course,  for  pure  integer  problems  as  well  as  for  MIP 
problems . 

Upper  bounding  by  monotonicity  zmd  feztsibility  are  elementzury: 

v(b)  £ v(b)  for  all  b ^ b 

v(b)  ^ f(x,y)  for  zill  b e B such  that 

(x,y)  is  feasible  in  (P)  . 

10.3  Relaxations  zmd  Lower  Bounding 

Lower  bounds  on  v(b)  derive  from  relaxations  of  (P)  . Linezu:  lower 
bounding  functions  are  easily  derived  from  a single  solution  of  a 
(continuous-variable)  relaxation  and  can  point  out  the  possibility  or 
impossibility  of  substantial  jumps  in  the  optimzd  value  of  v(b'. 

A minimizing  problem  (Q)  is  said  to  be  a relzucation  of  (P)  if  for 
any  b e B the  feasible  region  of  (Q)  contains  F(b)  zmd  the  objective 
function  of  (Q)  nowhere  exceeds  f(*,*)  on  F(b).  This  definition  accom- 
modates a generalized  Lagrangean  program—^  within  its  scope. 

A common  approach  to  relaxation  of  (P)  is  convex! fication  in  the 
domain  space.  Let  W be  zuiy  convex  set  in  such  that  U c W.  (Since 

-'See,  e.g.  , Roode  [15]. 
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U is  compact,  it  cem  be  assimed  without  loss  of  generality  that  W is 


compact.)  The  continuous -variable  problem 

(P  ) : Minimize  £(x,y)  |G(x,y)  £b 

(x,y)eW 

is  a relaxation  of  (P) . Of  particular  interest  will  be  the  sets  W e 

Co(U)  6md  W = Uq  where  denotes  U without  the  integrality  restrictions 

on  y.  The  optimal  value  of  (P  ) is  denoted  by  v (b)  . It  will  be 

w w 

assimed  in  this  section  that  f and  G are  convex  on  W.  Hen;e,  v (•)  is 

w 

also  convex. 


I 


Theorem  10.1;  Given  that  (P..)  has  a feasible  solution,  if  y (p  < 0)  is 
W — 

*/ 

a vector  of  optimal  dual  variedsles-*  for  (P^^) , then 


v(b+Ab)  > V (b)  + p*Ab 

^ w 


(10.3) 


for  all  Ab  e E®. 


Proof:  The  fact  that  p is  a subgradient  to  v..(*)  at  b follows  from 


[ 5 , Th . 1 ] : thus , 


v„(b+Ab)  > v„{b)  + p*Ab 
W — W 


(10.4) 


cind  (10.3)  follows  since  (P,,)  is  a relaxation  of  (P)  . 

W 

This  result  clearly  holds  also  when  the  objective  function  of  (P  ) 

w 


is  any  convex  function  on  W which  nowhere  exceeds  f(»,*)  on  F(b). 


mi 


A comment  on  the  existence  of  p is  in  order.  Let  = {b  e E 

(P  ) is  feasible).  A vector  of  optimal  dual  variables  exists  (is  finite) 

w 


K 

J 

_ 

-'That  is,  p satisfies  the  usual  optimality  conditions — see  Geoffrion 
[5]  , p.  5 — with  the  convention  that  p ^ 0.  This  convention  is  adopted 
so  that  p can  be  interpreted  as  a subgradient  of  Vj^(*)  without  the  need 
for  a sign  change. 
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*/ 

for  (P„) , b e B,,,  if  (P„)  is  "stable":-'  there  exists  M > 0 such  that 

v^(b)  - v^(b+Ab)  £ Ml|Ab|  for  all  Ab  e E™  (where  the  norm  ||  • | is  .virbi- 

trary;  note  that  v (b)  is  finite  for  b e B since  W is  conf>act)  . Con- 
w w 

vexity  and  finiteness  of  v (•)  on  B assures  that  an  optimal  p exists 

w w 

when  b e int(B^)  — (cf.  f 5 , Th.  6)).  If  b is  a boundary  point  of  B^, 

(P  ) is  clearly  stable  if  the  objective  function  f satisfies  a Lipschitz 
w 

condition:  there  exists  an  M > 0 such  that 


t 


•9 


|f(x,y)  - f(x',y')|  £M||(x,y)  - {x’,y')|| 

for  all  (x,y)  , (x, ' ,y ' ) e W.  If  (P  ) is  linear,  w exists  emd  is  avail- 

w 

able  from  the  final  tableau  of  the  simplex  procedure. 

Combining  the  lowe'  bound  (10.3)  with  upper  bounding  by  feasibility 
results  in  the  following  e-optimality  property. 

Theorem  10.2;  Let  (x,y)  and  \i  be  optimal  (primal  and  dual  varied>les, 

respectively)  in  problem  (P^)  . Let  (x,y)  euid  Ab  be  such  that  (x,y)  is 

feasible  in  (P)  with  right-side  b+Ab.  Then  (x,y)  is  e-optimal  at  b+Ab 

in  (P)  where  e = Af-p*Ab  (Af  = f (x,y) -f  (x.y)  = f (x,y) -v  (b) ) . 

w 

Proof:  0 ^ f(x,y)  - v(b+Ab)  by  feasibility 

^ f(x,y)  - V (b)  - iJ’Ab  by  (10.3) 
w 

= f(x,y)  - f(x,y)  - u*Ab 

= e . II 

An  obvious  application  of  Theorem  10.2  is  to  the  "rounding"  of  a y 

which,  together  with  x,  is  optimal  in  (P„)  • This  application  is  studied 

w 

in  Chapter  11;  it  will  be  shown  that  for  certain  specializations  of  (P)  , 
c = 0 in  Theorem  10.2  when  y is  selected  as  a rounding  of  y.  It  is 

*7 

— 'cf.  Gale  [2],  Geoffrion  (5]. 
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worth  noting  that  a nondiscrete  ^ nay  be  acceptable  in  a quasi-integer 
sense  (cf.  Ch.  7). 

It  will  be  instructive  to  study  the  properties  of  problem  (P  ) 

w 

where  W = Co(U) . This  problem  is  denoted  by  (P.)  and  its  optimal  value 


by  v^ (b) : 


(P^)  Minimize  f(x,y)  |G(x,y)  £ b 
(x,y)£Co(U) 


The  following  result  is  a generalization  of  a property  established  by 
Geoffrion  [6,  Th.  4]. 

Theorem  10.3;  The  (convex)  function  v^(*)  is  the  lower  convex  envelope 
of  v( • ) . 


Proof; 


E i Epigraph (v(-) I = { (A, b) | X ^ v (b) } 

= {(A,b)|X  ^f(x,y),  G(x,y)  £b  for  scxne  (x,y)  e U}. 


E*  is  defined  in  the  same  way  except  that  U is  replaced  by  Co(U).  The 
theorem  asserts  that  E*  is  the  convex  hull  of  E.  The  epigrapii  E*  is 
convex  since  v^  is  convex.  Also,  v^(b)  v(b)  V b so  that  E*  ^ Co(E). 
Next,  sv%)pose  that  (A,b)  e E*.  Then  A ^ f(x,y)  and  G(x,y)  £ b,  for 
(x,y)  c Co(U).  There  exists  (x^,y^)  c U such  that  (x,y)  = lB^(x^,y^), 
(6^  ^0/  = 1)  • Define  A^  H f(x^,y^),  b^  = G(x  ,y^).  Clearly, 

(A^,b^)  e E V j.  Hence,  IB^(A^,b^)  e Co(E)  and 

IB^(A^b^)  = (Z6^f(x\y^),  i:6^G{x^,y^)) 

^ (f(x,y),  G(x,y))  by  convexity  of  f eind  G 
< (A',b) 


which  implies  that  (A,b)  c Co(E)  cind  E*  cCo(E). 

When  W = Co(U)  the  lower  bound  relationship  (10.3)  holds  with 
equality  for  sane  perturbation  Ab  to  the  right-side  b: 
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Corollary  10.3.1;  Let  y be  £ui  optljnal  multiplier  vector  (subgradient) 
In  (P^)  . There  exists  a Ab  such  that 


v(b+Ab)  ■ ■■  v^(b+Ab)  . 


(10.5) 


Proof ; Suppose  not.  Then  v(b+Ab)  > v^(b)  + p«Ab  for  all  Ab.  Since 
X X Y is  compact,  all  values  for  v(«)  and  v^(*)  are  generated  on  a com- 
pact domain  B'.  Hence,  there  exists  a Y > 0 such  that  v(b+Ab)  ^ v^(b)  + 
W*Ab  + Y = r(Ab).  The  pointwise  maximum  of  r(Ab)  euid  v^(b+Ab)  is  a con- 
vex lower  bound  on  v(b+Ab)  which  exceeds  v^  by  y at  Ab  = 0,  contradict- 
ing the  fact  that  v^  is  the  envelope  function.  | | 

The  corollary  implies  that  v^(b)  + yAb  is  a linear  support  to  v(*) 

when  W = Co(U),  which  in  turn  implies  that  (x,y)  and  Ab  in  Theorem  10.2 

V 

can  be  selected  so  that  e = 0.-^  Consequently,  among  all  functions 
linear  in  Ab,  e as  defined  in  Theorem  10.2  gives  the  smallest  measure 
of  suboptimality  (when  W » Co(U)). 

Geometrically,  the  corollary  implies  that  v^(*)  is  linear  on  re- 
gions of  B where  v(b)  > v^(b)  and  that  v(b)  = v^(b)  at  all  extreme 
points  b of  (the  epigraph  of)  v^.  See  Figure  10.1.  This  property  of 
the  envelope  function  v^  is  intuitive  euid  holds  for  an  arbitrary  l.s.c. 
function  v(*);  a detailed  proof  is  given  in  Appendix  lOB. 


—'By  Corollary  10.3.1  there  exist  (x,y)  emd  Ab  such  that 

0 = v(b+Ab)  - [v,^  (b) +p  *Ab)  = (f  (x,y) -v*  (b)  ] - y*Ab  = e. 
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Figure  10.1.  Linearity  of  where  < v,  and 
Equality  of  2uid  v at  Extreme  Envelope  Points 

In  general  it  may  be  difficult  to  characterize  Co(U)  as  an  explicit 
set  of  constraints,  but  this  is  possible  at  least  in  principle.  In 
certain  special  cases  of  (P) , Co(U)  coincides  with  the  convex  set  ob- 
tained by  singly  dropping  the  integrality  constraints  on  y.  To  wit, 

let  Yq  be  such  that  Y = {y  c Y^jy  integer}  and  suppose  that  U = X x Y; 

*/ 

if  Yq  = Co(Y)  then  = X x = CodJ).-*  This  clearly  holds,  for 

example,  when  Y E {y|0  ^ ^ u^,  y^  integer},  and  also  holds  when  Y 

includes  GUB  constraints  on  y as  well  as  bounds  and  integrality.—'^ 

In  these  special  cases  v (•)  ■=  v.(»),  where  v (•)  corresponds  to  W e U. 

* 0 0 0 

in  (P^^)  . 

77 

-'Co(U)  = Co(X  X y)  = Co(X)  X Co(Y)  = X x Co(Y). 

^Let  Y E {y  e Y^jy  integer},  Y^  E {yjy^j  ^0,  = 1,  (i  = 1,. ..,!)}. 

Since  Yq  is  the  cross-product  of  sets  Yq  e {y|o  ^yj  ^1,  J^Yj  = 1}  it 

suffices  to  show  that  Yq  = Co(Y^).  Co(Y^)  c Y^  since  Y^  is  convex.  Let 
y e yJ  and  write  y = where  e^  = unit  vector  with  ]th  component 

unity.  Each  e^  e Y^  so  y^e  Co(Yi)  and  Y^  c Co(Y^)  . 
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10.4  A General  Rel^ucatlon 

A relaxation  is  studied  here  which  permits  the  "costs"  of  addition- 
al resources  Ab  to  be  represented  explicitly  in  the  model.  This  relax- 
ation of  (P)  produces,  besides  a linear  lower  bounding  function,  an 
alternative  solution  to  (P)  that  nets  the  greatest  inprovement  in  optimal 
value . 

Let  p(*)  be  any  function  piE*"  E satisfying  p(0)  * 0 and  p(z)  <_  0 
for  z ^ 0.  Such  functions  will  be  termed  "admissible."  The  following 
problem  is  a relaxation  of  (P) : 

(G)  Minimize  f(x,y)  + p(G(x,y)-b)  = V(p)  . 

(x,y)eU 

The  constraint  set  U c^m  be  replaced  by  any  set  W 3 Uj  in  either  case 
one  has 

v{b)  ^ V(p)  (10.6) 

for  all  admissible  functions  p.  Several  additional  relationships 
between  (P)  and  (G)  suggest  the  use  of  formulations  similar  to  (G)  for 
the  purpose  of  discovering  perturbations  Ab  to  b that  yield  net  improve- 
ments in  optimal  value. 


Theorem  10.4;  (a)  Given  p(’),  if  (x,y)  satisfies  the  conditions 

(i)  (x,y)  is  optimal  in  (G) 

(ii)  G(x,y)  ^ b 

then  (x,y)  is  e-optimal  in  (P)  where  e H -p(G(x,y)-b)  . 

(b)  If  (x,y)  is  optimal  in  (G) , then  (x,y)  is  optimal  in  (P)  with  b 
replaced  by  b = G(x,y)  , emd 

v(&)  * V(p)  - p(6-b)  . (10.7) 

(c)  v(b+Ab)  ^V(p)  - p(Ab)  for  all  Ab  e E™  . (10.8) 
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Prcx)f t Let  b = G(x,y)  . By  definition,  V(p)  ■ 

f (x,y)-e  1 v(b)  (by  (10.6)] 

£ f(x,y)  (by  feasibility  of  (x,y) 
in  problem  (P)]  . 

This  shows  part  (a).  To  establish  (b)  and  (c)  , let  Ab  - G(x,y)-b  and 
project  (G)  onto  (the  vari^±»les)  Ab: 

V(p)  - min  (p(Ab)  + min  f (x,y)  | G(x,y)  = b+Ab] 

Ab  (x,y)eU 

= min  (p(Ab^  + v(b+Ab)] 

Ab 

since  the  inner  problem  is  (P)  with  b replaced  by  b+Ab.  Clearly, 

V(p)  £ p(Ab)  + v(b+Ab)  for  all  Ab;  if  Ab  is  optimal  in  the  outer  prob- 
lem, then  V(p)  * p(b-b)  + v(L)  where  b = b+AL  ■ G(x,y)  . | | 

The  theorem  holds  for  completely  general  objective  amd  constraint 
functions  and  all  admissible  functions  p(»).  Notice  also  that  Theorem 
10.4(c)  holds  when  U in  (G)  is  replaced  by  any  convex  set  W ^ U. 

Solving  problem  (G)  produces  a solution  that  is  optimal  in  (P)  at 

some  perturbed  right-side  b+Ab  cind  that  provides  the  maucimum  net  improve- 

*/ 

ment  in  optimal  value.-'  Conditions  (i)  and  (ii)  together  with  the 
requirement  that  p(Ab)  = 0 are  sufficient  conditions  for  a solution 
(x,y)  to  be  optimal  in  (P)  . If  p satisfies  p(z)  = 0 for  z £ 0 then 
(i)  and  (ii)  alone  are  sufficient. 

The  class  of  admissible  penalty  functions  p is  very'  large.  Several 

practical  classes  of  functions  p(*)  are  discussed  below.  These  are 

depicted  in  two  dimensions  in  Figure  10.2.  Computationally,  a penalty 

V ! ~ 

The  maucimum  net  improvement  is  given  by 

m^  (v(b) -v(b+Ab) -p (Ab)  ] = V(b)-V(p)  £0  ; 

by  (10.7),  the  gross  improvement  v(b)-v(b+Ab)  £p(Ab). 
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p(')  may  best  be  handled  by  slightly  reformulating  (G)  to  Include  addi- 
tional variables  and  constraints  that  reflect  the  nature  of  p(*)« 


p(Ab)  = E X 'meut  {0,^,(iib,)} 
i-1  ^ ^ 


(10.9) 


where  X^  >^0,  (i  l,...,m),  Ab  = G(x,y)-b,  and 


convex  function  of  Ab.  where  (0)  ■ 0,  Ab,  <6, 

1 i i — 1 

M (very  large  number)  , Ab^  > 6^  . 


A penalty  is  incurred  only  for  positive  increments  Ab;  a very  large 
(effectively,  2ui  infinite)  penalty  is  assigned  to  a Ab  that  exceeds 
a prescribed  upper  bound  6 . Let<M*)  = (iji^^  (•),...  ,(j)^  (•))  . This 
type  of  penalty  p(*)  c^u^  be  implemented  by  modifying  (G)  as  follows: 


Minimize  f(x,y)  + X *iKz)  | G (x ,y) -z  <_  b 
(x,y)eU 
0<z<6 


(10.10) 


This  rel^ucation  of  (P)  permits  what  will  be  referred  to  as  "elas- 
tic resources,”  b+z.  Conventional  'onconstrained  optimization 
techniques  might  well  be  an  integral  part  of  a solution  approach 
to  (G)  (provided  all  functions  are  sufficiently  well-behaved) , 
especially  when  U reflects  only  variable  bounds  and  integrality 
constrciints . 


p(Ab)  = X'Ab,  where  Ab  = G(x,y)-b,  X > 0 


(10.11) 


This  yields  the  familiar  generalized  Lagrangean  Relaxation  of 

V 

problem  (P)  Notice  that  (G)  with  U replaced  by  Co(U)  — call 


this  problem  (G^)  — is  a relaxation  of  (P^)  . When  (P)  is  linear, 
a computationally  attractive  relationship  holds  between  (P) , (G^) 

_ 

— Cf.  Everett  [1],  Roode  (15),  euid  Geoff rion  (5,6)  • Only  the  last  of 
these  addresses  Lagrangean  Relaxation  in  the  context  of  integer  pro- 
gramming, however;  other  references  are  cited  in  [6). 
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and  (P^) : an  optimal  solution  to  (G^)  is  given  by  one  of  the 

extreme  (vertex)  points  of  Cc  (U)  . I'his  solution  is  feasible  in 
(P)  at  a perturbed  right-side  b,  and  is  therefore  optim^d.  at  b in 
all  three  problems,  (P) , (P^)  and  (G^)  - Consequently,  an  alterna- 
tive optimal  solution  to  (P)  may  be  obtained  by  solving  the  LP 
problem  (G^)  . This  property,  of  course,  is  implementable  only 
when  Co(U)  can  be  characterized  in  terms  of  linear  constraints 
(for  instance,  when  Co(U)  - as  was  discussed  earlier). 

(C)  p(Ab)  piecewise-linear,  possibly  discontinuous  (see  Fig.  10.1c) . 

A fixed  charge  is  incurred  for  increments  Ab^  exceeding  a prescribed 
threshold  6^.  Problem  (G)  can  be  expressed  as  an  MIP  by  introduc- 
ing integer  variables  corresponding  to  the  discrete  charges  and 
oontinuous  variables  corresponding  to  each  linear  piece  of  p(*)  . 


p(Ab) 


p(Ab) 


p(Ab) 


(A) 


Figure  10.2.  Exaitple  Types  of  Admissible  Functions  p(*) 
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APPROXIMATING  LOCAL  BEHAVIOR  CF  THE  OPTIMAL  VALUE  FUNCTION 


Let  y*  be  optimal  in  (P)  with  RS  b;  the  subproblem  (P  ) is  studied 

y 

as  2m  indicator  of  the  local  behavior  of  v(b)  . Dual  variiQsles  p* 
associated  with  b«  optimal  in  • can  be  interpreted  (with  the  proper 

sign  convention)  as  a subgradient  of  v(*)  at  b. 

Application  of  the  duals  p*  from  problem  (Py*)  to  problem  (P)  is 
implied  by  the  following  results. 

Theorem.  If  f and  G are  l.s.c.  on  X @ Y and  if  y*  is  uniquely  optimal 
at  b,  then  there  exists  a Ab  > 0 such  that 

v(b)  = v *(b),  for  b < b < b + Ab  . (lOA.l) 

y ~ ~ 

Consequently,  p*  is  a subgradient  to  both  v(»)  and  v^^(»)  at  b.  If,  in 

adoition,  y*  is  strongly  feasible  at  b,  then  there  exists  a Ab'  >0 

*/ 

such  that-' 

v(b)  = V ,(b),  for  b - Ab'  < b < b + Ab'  . (10A.2) 

y*  - - 


Proof ; The  feasible  region  F(*)  is  a closed  map  by  Theorem  3.9;  by 
Theorem  3.11  there  exists  a neighborhood  N(b)  such  that  y e Y is  feas- 
ible at  b e N(b)  only  if  it  is  feasible  at  b.  That  is,  if  y is  infeas- 
ible at  b then  y is  infeasible  at  all  b e N (b) . Moreover,  there  exists 
an  e > 0 such  that  for  any  y feasible  at  b,  y ^ y*  t 


V (b)  > v(b)  + e 

y - 


since  y*  is  uniquely  optimal  emd  Y is  finite. 


(10A.3) 


By  Theorem  3.10, 


V (•) 

y 


is 


* / — — 

The  condition  b £ b ^ b+Ab  for  some  Ab  > 0 can  be  replaced  by  the  more 
general  conditiotis  that  F(b)  OF(b)  and  b e N(b)  where  N(b)  is  some 
neighborhood  of  b and  F(’)  denotes  the  feasible  region. 
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l.s.c.  at  b,  y e Y.  Hence,  there  exists  a neighborhood  Ng(b),  depend- 

- */ 

ing  on  e,  such  that  for  emy  y feasible  at  b,-* 

V (b)  < V (b)  + c,  be  N , (b)  . (10A.4) 

y y ^ 

Combining  (10A.3)  and  (10A.4),  v(b)  < v^Cb).  But,  for  all  b9F(b)  D F(b), 
V ^(b)  V (b)  = v(b)  so  that  y*  is  optimal  for  all  b e Nr(b)  0 N(b) 

y»  — y **  * 0 

for  which  F(b)  riF(b).  This  establishes  result  (lOA.l).  Result  (10A.2) 
follows  from  Theorem  4.6  (3  N'(b)  5 y*  is  optimal  at  all  b e N'(b^)  for 
which  F(b)  cr  F(b))  and  result  (lOA.l),  II 


In  the  linear  case,  (P  .)  is  an  LP  problem  and  M*  is  available  from 

y* 


the  final  tableau  of  the  simplex  procedure.  Assuming  nondegeneracy, 

(b- 

1/ 


1/ 


there  exists  a b > b such  that  v .(b)  = v * (b)  + vi*‘(b-b)  where  b < b < 

y*  y*  - - 


b.  By  the  theorem,  if  y*  is  uniquely  optimal  in  (P)  ,- 


Av(b)  = y* 

and  there  exists  a Ab  > 0 such  that 


v(b)  = v(b)  + y**Ab,  b < b <•  b + Ab  . (10A.5) 


The  weakness  in  application  of  the  theorem  and  the  shortcoming  of 
dual  varia±)le  interpretations,—'^  is  that  Ab  is  not  knoviTi  and  cannot  be 
determined  by  analyzing  subproblem  (Py*)  alone.  This  deficiency  is 
depicted  in  Figure  lOA.l  (for  one  component  of  b)  . The  size  of  Ab 


depends  not  only  on  v^^(b)  but  also  on  all  other  contending  functions. 


*/  — ... 

-'Feasibility  of  y at  b is  needed  for  strict  inequality  in  (10A.4)  . 

t/ 

— See  Luenberger  [10] , p.  76. 

—^Uniqueness  is  a stronger  assumption  thcui  is  necessary:  the  conclu- 

sions hold  as  long  as  y*  remains  optimal  for  an  increment  Ab_to  b, 
which  can  be  the  case  even  if  y*  is  not  uniq  jely  optimal  at  b. 

^Reference  is  to  imputation  of  dual  prices;  s."e,  for  instance,  Hespel 
[71. 
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v^(b) , y E Y. 


A ranging  cinalysis  that  determines  or  bounds  the  componentwise 
increments  to  b for  which  (lOA.l)  or  (10A.5)  holds  is  possible  by  analyz- 
ing all  subproblem  functions  v^.  I i the  context  of  branch-^md-bound  this 
amounts  to  analyzing  the  subproblem  at  each  fathomed  node  to  determine 
or  bound  the  increments  Ab^  for  which  the  fathoming  conditions  remain 
valid.  Roodman  [16,17]  exploits  this  idea  and  presents  an  algorithm  and 
computational  results  for  both  pure  and  mixed  integer  linear  progrcuns. 

The  major  shortcoming  of  ranging  analysis  as  a meems  for  gaining 
sensitivity  information  is  that  it  has  no  mechanism  for  considering 
discrete  improvements  in  v at  points  of  discontinuity.  However,  results 
may  ue  more  significamt  and  meaningful  when  applied  to  MIP  problems  for 

which  v(b)  is  continuous.  Several  examples  of  continuous  MIP  problems 

V 

were  mentioned  in  Part  I.-* 

_ 

-'For  example:  uncapacitated  facility  location  problems  (b  = demands); 

the  nonlinear  dyneimic  lot  size  model  (4.18);  the  goal  programning  model 
(7.7);  capital  budgeting  problems  with  ix>th  lending  and  borrowing,  such 
as  (7.5) — see  also  Weingartner  [19],  p.  142;  another  example  is  the 
minimax  regression  problem  studied  by  Schrage  [18]. 


APPENDIX  lOB 


A CHARACTERISTIC  Of  V AND  THE  ENVELOPE  FUNCTION 

Let  Q CB  denote  the  set  of  axtreme  points  of  (more  precisely, 
of  the  epigraph  of  v^)  . 

Theorem;  The  functions  v(*)  emd  v^(*)  coincide  on  Q. 

Proof;  Suppose  for  some  b g Q that  v(6)  « v^(b)+y  where  y > 0.  Let 

h(*)  be  any  line2u:  si^port  to  v^(*)  at  b 3 h(b)  = (b)  and  h(b)  < v^(b) 

for  h h [this  is  always  possible  at  an  extreme  point  b] . We  will  show 
that 

3 <5  > 0 5 v(b)  > h(b)  +6,  V b e B . (lOB.l) 

Given  that  this  property  he  Ids  the  theorem  follows  easily;  the  convex 
hull  of  the  epigraph  of  v(*)  is  contained  in  the  epigraph  of 
maximum  (h(b) ,v^(b) ] , which  in  turn  is  a proper  subset  of  the  epigraph 
of  v^(*)  since  v^(b)  < h(b)+6,  implying  that  v^^(»)  is  not  the  convex 
envelope  of  v(»).  This  contradiction  then  yields  the  desired  result. 

See  Figure  lOB.l. 

To  establish  (lOB.l)  it  will  first  be  shown  to  hold  in  some  neighbor- 
hood N^  (b) . Since  v(*)  is  l.s.c.  j o'  >0  3 v(b)  > v(b)  - y/2, 

V b e N^,(b).  Consequently,  the  assumption  that  v(b)  = v^(b)+Y  leads 
to  v(b)  > V (b)  + y/2  for  b e N , (b) . New  by  continuity  of  v (•)  on  B, 

3 0,  0<o£o',^v^(b)  + y/4  > v^  (b) , V b e B N^  (b)  ; therefore , 

v(b)  > v^(b)  + y/4,  V b e B 0 N^ (b)  . (10B.2) 


162 


v^(b)  + 6 


vjb) 


- 

Y .v(b) 


h(b) 

I “ “ r ^ V 

I I 


Figure  lOB.l.  Contradiction:  is  Not  the  Convex 

Envelope  if  v(b)  fi  v^(b) 


Suppose  next  that  there  is  no  6 > 0 for  whid:  (lOB.l)  holds.  Then 

Vn,]beB5v(b)  < h(b)  + — . Thus,  3 a sequence  } -►  b e B 

n 

_ (q)  — — 

(B  is  closed)  5 v(b  ) -►  h(b).  Because  v^  is  continuous  (uniformly  in 
any  closed  neighborhood  of  b) , v(b)  ^ v^(b)  ^ h(b)  V b ”0  v^(b^^^)  -► 
v^(b)  = h(b)  b = b.  But  (B2)  states  chat  v(b)  is  bounded  away  from 
(b)  = h(b)  in  a neighborhood  of  b,  so  that  no  such  sequence  {b  ^ } 
exists;  therefore,  3 '5  > 0 5 (lOB.l)  holds.  || 

The  extreme  envelope  points  are  of  particular  interest  in  sensi- 
tivity cinalysis  since  they  represent  the  "low"  points  on  the  graph  of 
the  optimal  value  function.  The  message  of  the  theorem  is  that  at  each 
extreme  point  b there  is  an  optimal  solution  of  the  problem  (P^)  tnat 


is  feasible  and  optimal  in  the  MIP  problem  (P)  . 


CHAPTER  11 


SENSITIVITY  TO  RIGHT-SIDE  DATA;  ANALYSIS  METHODS 

We  again  address  the  MIP  problem 

I Minimize  f(Xiy) 

'P)  i subject  tor  (1)  G(x,y)  ^ b 

(2)  (x,y)  E U 

studied  in  Chapter  10;  a nominal  right-side  value  is  denoted  by  b.  The 
analysis  methods  discussed  in  this  chapter  draw  upon  the  foundational 
concepts  2uid  properties  presented  in  Chapter  10. 

A general  approach  to  RS  analysis  is  described  below  that  relies  on 
the  combined  application  of  several  etnalysis  techniques.  Alternative 
analysis  methods  and  techniques  are  briefly  examined  amd  the  most  sig- 
nificant of  these  singled  out  for  a detailed  treatment  in  subsequent 
sections . 

11 . 1 A Basic  Approach  and  Alternative  Analysis  Methods 
The  analysis  proceeds  in  two  phases  {cf.  §8.2)  : 

(A)  Determine  how  much  improvement  in  v is  possible  with  reason- 
able perturbations  to  the  RS  data  b. 

(B)  Derive  alternative  solutions  that  provide  substantial  net 
improvements  in  v with  acceptable  associated  perturbations  Ab. 

A simple  emalysis  in  Phase  A may  alleviate  the  need  for  the  more  exten- 
sive computational  requirements  in  Phase  B.  Analysis  methods  for  each 
phase  will  be  discussed  in  turn. 

For  Phase  A there  are  two  computationally  inexpensive  indicators 
of  the  potential  improvement  possible  in  v.  These  are  the  bounds  on 
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I M 


v(b)  given  by  (10.1)  and  (10.3): 

v^(b)  + u*Ab  £ v(b+Ab)  £V^^(b+Ab)  (11.1) 

where  v,,  and  u < 0 correspond  to  £ui  optimal  solution  of  (P„)  juid  v ^ 

W — W y* 

corresponds  to  (P  *)  in  which  y*,  optimal  in  (P)  at  b,  is  held  fixed. 

y 

These  bounds  cein  be  interpreted  as  bounds  on  the  amount  of  improvement 
v(b)  - v(b+Ab)  that  is  possible.  Let  6 denote  the  gap  between  v cind  v 

w 

at  b:  & = v(b)  - V (b)  . Then  for  cmy  Ab,  the  improvement  in  v(*)  is 

w 

bounded  as  follows  (see  Figure  11.1): 


v(b)  - Vy^(b+Ab)  £ v(b)  - v(b+Ab)  £ <5  + (~U)  *Ab 


(11.2) 


I 


Figure  11.1.  The  Bounds  on  v(b)  Indicate  the  Potential 
for  Improvement  in  v(b) 


Based  on  these  bounds,  two  conclusions  may  possibly  be  drawn. 

(1)  T)ie  upper  bound  6+(-u)*Ab  is  "sufficiently  small"  for  reason- 
able Ab's  that  alternative  improving  solutions  are  no  longer 
of  interest. 

(2)  The  lower  bound  v(b)  - v^^ (b+Ab)  is  "sufficiently  large"  (for 
some  Ab)  that  a search  for  alternative  solutions  is  worth- 
while . 
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If  neither  of  these  bounding  tests  is  .if  f irmati  ve  l lu-n  LIum  pi  e llniln.-u  y 
euialysis  of  bounds  is  inconclusive  — substeuitial  net  improvements  in  v 
may  or  may  not  be  possible. 

Several  comments  are  in  order.  When  the  "costs"  associated  with  a 
perturbation  Ab  are  nonquantifiable  and  subjective  in  nature  the  bound- 
ing tests  (1)  and  (2)  are  likewise  subjective.  By  "sufficiently  small" 
is  meant  ^ul  insignificamt  net  improvement  in  v when  all  types  of  costs 
assigned  to  Ab  are  considered.  The  bound  6+(-u)*Ab  on  the  maximum 
possible  improvement  (given  Ab)  must  be  weighed  against  the  consequential 
costs  of  the  perturbation  Ab;  although  the  bound  may  in  some  sense  be 
large,  a counteracting  penalty  on  Ab  may  produce  an  insignificauit  net 
potential  in^rovement  in  v.  A similar  consideration  applies  to  the  term 
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the  sensitivity  of  v to  b.  In  the  vein  of  the  latter,  the  following 
exploratory  run  may  be  made:  select  a RS  b'  b 2Uid  solve  (P)  at  b'. 

By  monotonicity,  v(b)  v(b)  ^ v(b')  for  all  b such  that  b £ b ^ b'. 

This  leads  to  two  more  tests: 

(!')  The  inprovement  v(b)  - v(b')  is  so  small  that  alternative 

solutions  resulting  from  perturbed  values  b (b  £b  _<  b*)  are 
no  longer  of  interest. 

(2')  The  iirprovement  v(b)  - v(b')  less  the  costs  assigned  to 

Ab*  ^ (b'-s*)-b  (where  s*  denotes  optimal  slack)  is  substan- 
tial — Phase  B is  indicated. 

These  tests  also  cam  be  inconclusive  and  one  must  be  careful  in 
drawing  conclusions:  there  cam  exist  perturbations  Ab  that  are  much 

preferred  over  Ab*  and  which  yield  am  improvement  comparable  in  magni- 
tude to  v(b)  - v(b').  If  p(Ab")  represents  a cost  assigned  to  Ab*  then 
the  quantity  v(b)  - v(b')  - p(Ab*)  is  a lower  bound  on  the  net  improve- 
ment possible  in  v(‘);  an  encouragingly  high  value  of  this  lower  bound 
leads  to  conclusion  (2').  Conclusion  (1'),  hcwever,  is  based  only  on 
the  gross  difference  v(b)  - v(b'),  which  represents  am  upper  bound  on 
the  improvement  arising  from  a Ab,  0 ^ Ab  ^ b’-b. 

It  is  worth  noting  that  the  upper  bound  in  (11.2)  can  result  as  a 

*/ 

byproduct  of  solving  (P)  By  executing  an  exploratory  run  an  addi- 
tional bound  is  generated,  thus  strengthening  the  bounding  tests. 

When  the  majority  of  the  costs  incurred  by  perturbations  Ab  can  be 
expressed  functionally,  relaxation  (G)  becomes  an  attractive  alternative 
to  the  Phase  A techniques  just  discussed.  Choose  p(Ab)  as  any  convenient 

*/  —4 

-^E.g.,  an  LP  start  in  branch-bound  yields  the  linear  lower  bound  on  v 
(upper  bound  in  (11.2)),  where  W = Uq- 

i 
» 


i 
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conservatively  low  approximation  to  the  true  costs  associated  with  Ab, 
where  p(Ab)  ■ 0 for  Ab  ^ 0 (i.e.,  a type  A penalty;  cf.  §10.4).  Then 
solving  problem  (G)  leads  to  a generalization  of  tests  (1')  and  (2*): 
if  there  do  not  exist  alternative  solutions  that  provide  a net  improve- 
ment in  V,  then  the  solution  to  (G)  will  satisfy  the  optimality  condi- 
tions of  Theorem  10.4a.  Thus,  problem  (G)  produces  in  this  case  both  an 
optimal  solution  to  (P)  and  proof  of  the  fact  that  Phase  B would  be 
fruitless.  On  the  other  hand,  a nonzero  optimal  value  of  Ab  in  (g)  sug- 
gests a Phase  B analysis. 

Evidently,  relaxations  of  type  (G)  c^m  also  be  effective  in  meeting 
the  Phase  B objective:  (G)  produces  an  alternative  solution  to  (P)  that 

nets  the  maximum  improvement  in  v based  on  the  chosen  criterion  p(»). 

In  effect,  a solution  to  (G)  takes  advantage  of  discontinuities  in  v. 

Subjective  cost  considerations  can  be  accommodated  by  varying  the  costs 
p(*)  to  yield  a collection  of  alternative  improving  solutions.  Ideally, 
these  variations  in  p would  represent  the  range  of  both  quantifiable 
cind  nonqueuitifiable  costs  associated  with  perturbations  in  the  resource 
availabilities  b.  Relaxations  of  typo  (G)  , particularly  the  elastic 
resource  model  (10.10),  are  exploited  further  in  a later  section. 

Relaxations  built  on  convex! fication  in  domain  space  (e.g.,  drop- 
ping integrality  constraints)  generally  produce  fractional  values  for 
the  discrete  variables  y.  "Rounding " refers  to  the  rounding  up  or  down 
of  these  fractional  variables  in  an  effort  to  obtain  a solution  that  is 
feasible  in  (P)  , and  is  a natural  approach  for  constructing  a solution 
to  pure  integer  problems.  Hopefully,  clever  rounding  of  a noninteger 
solution  will  produce  a near-optimal  solution;  when  this  works,  the 
integer  solution  is  obtained  at  a fraction  of  the  computational  cost 
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that  would  be  required  by  an  integer  programning  algorithm. 

The  objective  for  studying  rounding  here  is  to  consider  it  not  as 
a means  for  solving  an  integer  problem,  but  rather  as  a possible  me^uls 
for  obtaining  alternative  improving  solutions.  In  particular,  we  search 
for  situations  in  which  rounding  can  produce  a solution  that  is  feasible 
eind  optimal  at  a perturbed  right-side  data  point.  When  a rounded  solu- 
tion is  not  known  to  be  optimal  at  the  associated  RS  b,  then  a limit  (c) 
on  suboptimality  is  provided  by  Theorem  10.2. 

Rounding  is  discussed  in  detail  in  the  next  section.  The  primary 
incentive  for  using  rounding  to  obtain  alternative  solutions  is,  of 
course,  the  relatively  very  low  computational  cost.  A shortcoming  is 
the  little  amount  of  control  over  the  magnitude  of  the  induced  perturba- 
tion Ab. 

The  execution  of  exploratory  runs  using  alternative  right-sides  b 
might  also  be  considered  as  a Phase  B method.  To  be  effective,  this 
method  would  require  solving  (P)  at  several  or  many  RS  points  b,  possi- 
bly calling  for  an  application  of  parametric  integer  programming  (cf. 
Nauss  (12j).  The  exploration  method  is  straightforward  to  execute, 
requires  no  alterations  to  the  model  (except  for  changes  in  RS  data)  , 
and  provides  direct  control  over  the  perturbations  Ab.  On  the  other 
hand,  its  brute  force  application  can  be  wasteful  in  that  meuiy  lindesir- 
able  alternative  solutions  may  be  generated;  even  worse,  it  does  not 
dependably  seek  out  discontinuities  in  v(«)  and  the  most  preferred 
alternative  solutions  can  remain  undiscovered. 

Restricting  the  RS  data  to  vary  in  parametric  fashion,  b+0r,  tends 
to  make  the  analysis  ijroblem  more  comprehensible.  The  optimal  value  v 
is  a function  of  tlie  scalar  vari£d>lc  0,  the  bounding  tests  are  simplified, 
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2md  the  relationships  between  (P)  and  its  releucations  per  Theorem  10.4 
(and  §11.3)  are  easily  specialized.  Although  obvious  simplifications 
result  by  considering  parametric  RS,  the  suitability  of  such  a restric- 
tion for  the  particular  application  must  be  considered  — in  some  in- 
steuices  a par2unetric  analysis  c<ui  provide  only  partial  sensitivity 
information  emd  cannot  dependably  produce  the  most  preferred  alterna- 
tive solutions. 

11.2  Rounding 

*/ 

A special  rounding  property  of  knapsack  problems-*  motivates  in- 
vestigation of  rounding  as  a means  for  sensitivity  analysis  in  more 
general  applications.  The  knapsack  problem  is  stated  as  follows: 

/ n 

Maximize  E c.y, 
i»l  ^ ^ 

, and  (11.3) 

integer 

n 

subject  to:  E a.y.  <_  b 

i=l  ^ ^ 

where  it  is  assuned  that  c ^ 0 and  a ^ 0.  It  is  well-known  that  an 
optimal  solution  to  the  LP  relaxation  (i.e.,  the  LP  problem  obtained  by 
dropping  the  integrality  requirements)  may  have  at  most  one  fractional 
variable  and  that  rounding  this  fractional  variedsle  either  or  down 
yields  a solution  that  is  optimal  in  (11.3)  for  some  modified  right-side 
value  b ' . 

To  be  specific,  let  'p  denote  an  optimal  solution  to  the  LP  relax- 
ation of  (11.3).  If  p is  integral  in  each  componenc  then  it  is  obvi- 
ously feasible  and  optimal  in  (11.3).  If  y*^  is  not  integral  in  each 

- Cf.  Garfinkel  and  Nemhauser  (3),  Chapter  6. 
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component  then  exactly  one  con^nent  is  fractional,  say  y^.  Let  ^ 
differ  from  y^  only  in  that  the  fractional  component  is  replaced  by  its 
integer  part,  [y^]  ; similarly,  let  y differ  from  y^  only  in  that  the 
fractional  component  is  replaced  by  its  integer  part  plus  one:  [y^]+l. 
Secondly,  define  ^ e;  and  b i i'^en  is  optimal  at  ^ and  y 


is  optimal  at  b in  (11.3). 

The  optimal  value  function  for  the  LP  relaxation  of  (11.3) 

is  concave  amd  piecewise  linear  on  (0,“)  with  n*  brea)c  points  (n*  £ n)  . 
It  is  interesting  to  note  that  each  of  these  n'  values  of  b (and  only 
these  values)  yields  a natural  integer  solution  to  (11.3).  This  sug- 
gests that  naturally  integer  solutions  might  be  found  to  more  general 
MIP  problems  by  identifying  break  points  of  the  continuous  envelope 
function  v^ ( • ) [in  problem  (11.3),  Vq(*)  = v^(*)]. 

With  reference  again  to  problem  (P)  , a rather  obvious  procedure 
for  using  rounding  to  obtain  an  alternate  solution  is  suggested  by 
Theorem  10.2.  Select  a convex  set  V)  ^ U;  assume  that  f and  G are  con- 
vex on  W: 


(a)  Solve  relaxation  (P  ) at  b,  obtaining  (x,y)  and  an  optimal 

w 

multiplier  vector  y ^ 0 (assuming  one  exists) . 

(b)  If  y is  fractional,  round  y to  y (and  adjust  x if  necessary 
to  some  value  x)  so  that  (x,y)  is  feasible  in  (P)  except  for 
possible  violation  of  constraints  (1)  . 

(c)  Adjust  h to  b'  if  necessary  so  that  (x,y)  is  feasible  at  b* 
in  (P). 

(d)  Then  (x,y)  is  t -optimal  in  (P)  at  the  perturbed  RS  b',  where 
f = f(x,y)  - f(x,y)  - ij(b’-b). 
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Uf  course,  whenever  possible,  steps  (b)  and  (c)  should  be  executed  in  a 
way  that  tends  to  minimize  e.  If  Co(U)  can  be  characterized  in  terms 
of  a set  of  convex  constraints  and  is  selected  as  the  set  W,  then 
Corollary  10.3.1  assures  that  there  exists  a (x,y)  such  that  e = 0;  but 
this  does  not  imply  that  such  a solution  can  be  generated  via  rounding 
of  y. 

We  will  show  that  for  the  following  class  of  problems  an  "optimal 
rounding"  — that  is,  a rounding  that  is  optimal  at  some  perturbed  RS 
point  — is  always  possible;  in  fact,  when  the  set  U involves  only 
bounds  and  integrality  constraints  on  the  y variables,  then  an  arbitrary 
rounding  of  y is  an  optimal  rounding,  where  y is  optimal  in  the  relaxa- 
tion obtained  by  simply  dropping  integrality  restrictions. 


'Minimize  f(x) 
subject  to: 


(SP)  < 


+ cy 

(1)  G(x)  + Ay  < b 


(2)  X e X 

(3)  y c Y 


where  c auid  A are  constants  of  the  appropriate  dimensions  and  Co(Y)  is 
polyhedral;  no  assumptions  on  f or  G are  needed.  As  in  previous  nota- 
tion, Y in  constraints  (3)  replaced  by  Y^  yields  the  problem  (SP^^)  and 
Y replaced  by  Co(Y)  yields  (SP^)  since  Co(X«Y)  = X * Co(Y) . 

Theorem  11.1:  (a)  Let  (x,y)  and  y ../ptimal  in  (SP^)  where  u is  a 

multiplier  vector  associated  with  b.  There  exist  roundings  y of  y such 

_ - _ */ 
that  (x,y)  is  optimal  in  (SP)  with  b perturbed  to  any  b'  satisfying— 


*/  — — 

-'The  conditions  y = 0,  0 in  (11.4)  can  be  replaced  by  the  slight- 
ly stronger  ones:  s,  > 0,  = 0,  respectively,  whore  s denotes  the 

slaclc  G(^+Ay-F. 


17;^ 


0 


(11.4) 


>_  [G(x)  + Ay)^,  if  - 

- (G(x)  Ay)^,  if  < 0 . 

(b)  Suppose  that  Y “ {y|0  £ y £ u,  y integer}  where  the  bound  u is 
integer.  Let  (x",y)  and  p be  optimal  in  (SP^) . Arbitrarily  round  y to 
y (or  replace  y by  any  y e Y)  . Then  (x,y)  is  optimal  in  (SP)  at  any  b' 
satisfying  (11.4). 

Proof t Project  (SP)  onto  the  x variables: 

Min  [f(x)  + min  cy  j Ay  £ b - G(x)]  . (11.5) 

x£X  yeY 

A Lagrangean  Relaxation  of  the  inner  problem  is  given  by 

Min  cy  + p(b  - G(x)  - Ay] 
yeY 

which  can  be  rewritten  as  the  LP  problem 

p(b-G(x)l  + Min  (c-pA)y  . (11.6) 

yeCo(Y) 

Now  y and  p must  satisfy  the  conditions: 

(i)  y minimizes  (c-pA)y  s.t.  y e Co(Y), 

(ii)  Ay  £ b - G(x)  , 

(iii)  iTlb  - G(x)  - Ay]  = 0. 

Result  (a)  can  be  reasoned  as  follows:  if  y is  fractional  then  it  is 
not  an  extreme  point  of  Co(Y)  — it  must  lie  on  an  edge  or  face  of 
Co(Y)  and  every  point  on  this  edge  (or  face)  of  Co(Y)  is  optimal  in 

(11.6) ;  this  includes  some  roundings  of  y (e.g.,  the  extreme  points  of 
Uie  face)  . 

In  part  ()j)  , Co(Y)  = Y^  {y|0  £y  £u).  Notice  that  if  y^  is  frac- 
tional tlien  (c-pA)j  = 0 since  otherwise  y^  would  not  be  minimizing  in 

(11.6)  subject  to  0 £ y^  £ u^  . Replace  the  fractional  y^  by  einy  y^  such 
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that  y c Y;  let  b'  satisfy  (11.4).  Then  by  construction,  (x,y)  and  ij 
satisfy  the  optimality  conditions: 

(i)  (x,y)  minimizes  f (x)  + cy  + u(b*-G(x)-Ay)  subject  to 

X e X,  y c Yq  (since  Co(XxY)  - X x y^) 

(ii)  G(x)  + Ay  £ b' 

(iii)  p(b'  - G(x)  - Ay)  = 0 

and  therefore  (x,y)  must  be  optimal  in  (SP).  || 

The  proof  reveals  the  utility  of  Lagrangean  Relaxation  for  identi- 
fying (simultaneous)  post-optimality  ranges  on  the  R^,  b. 

In  ceise  (a)  of  the  theorem  roundings  y must  be  selected  so  that 
they  satisfy  all  constraints  represented  by  the  set  Y.  Not  all  such 
feasible  roundings  are  optimal  in  (SP)  for  some  RS  b.  The  special 
structure  of  Y in  part  (b)  assures  that  any  rounding  is  feasible  in 
(SP)  for  some  b'.  For  more  complex  sets  Y,  a rounding  of  a y optimal 
in  (SPq)  might  not  be  optimal  at  any  perturbed  RS  b';  moreover,  it  is 
possible  that  no  such  optimal  roundings  exist,  as  is  demonstrated  by  the 
fol lowing  example. 

Maximize  20y^  + ^^^2  ^ ^3  ^ ^^1  ^ ^2  ^ ^ (11*7) 

yc't 

where  Y . {y|yj^.y2»y3  = 0 or  1;  + 2y^  ^ 2;  14y^  + Ty^  ^ L 

An  optimal  solution  to  the  LP  relaxation  obtained  by  dropping  integral- 
ity IS  given  by  y - (4/7,  5/7,  0).  only  one  rounding  of  y,  other  than 
the  trivial  one  (0,0,0),  is  contained  in  Y:  y = (0,1,0).  Correspond- 
ingly, O'  = 1.  But  y is  not  optimal  in  (11.7)  at  b'  --  y = (0,1,1)  is 
uniquely  optimal  (amd  this  is  not  a rounding  of  y)  . 

The  following  example,  exeimined  by  Rappaport  (i4l  and  by  Jensen 
( 8 J , illustrates  the  simplicity  cuid  practicality  of  using  rounding  to 
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obtain  alternative  (optimal)  solutions. 


Maximize 

yey 


25y^^  + lOy^  + 40y^  + lOOy^ 


subject  to:  12y^^  + ISy^  + 15y^  + 25y^  <_  3500  g 

lOy^^  + 12y^  + 20y^  + 20y^  3000 

O.Sy^^  + O.Sy^  + 0.6y^  + 2y^  ^ 240 

where  Y - {y|y  integer,  y^^  ^ 10,  y^  ^ 10}. 

This  problem  satisfies  the  conditions  of  Theorem  11.1(b);  hence,  any 
rounding  of  an  optimal  LP  solution  is  optimal  in  (11.8)  at  appropri 
ately  perturbed  RS  b.  Rappaport  obtained  iui  "acceptable"  solution  to 
(11.8)  by  solving  the  LP  relaxation  and  rounding  down  the  fractional 
variables  (thus  assuring  a feasible  solution) . Jensen  shows  in  [8] 
that  a better  integer  solution  exists  and  presents  the  following  compu 
tational  results: 


LP  Relaxation 

Rounded  Solution 

Optimal  Solution 

Vg  - 12,490 

- 12,410 

V » 12,470 

y,  “ 10 

- 10 

y - 10 

V - 4/3 
Vj  - 10  _ 

~ 1® 

o 

u 

fN» 

>. 

y = 49 

y^  - 49 

=*  48 

= 100/3 

y.  - 99.8 
4 

y^  - 99 



Va  * ^00 

4 

If  we  now  abandon  the  assumption  of  inelastic  resource  availabilities 
implicit  in  the  a±>ove  results,  then  a conspicuous  integer  solution  is 


the  one  obtained  by  rounding  y^  to  100.  This  requires  Ab  = (5, 0,0. 4) 
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and  yields  an  improved  objective  value  of  12,510.  This  rounded  solution 
is  optimal  by  Theorem  11.1(b);  as  a check,  e ■ c*Ay  - p*Ab  * 20  - 
1(4/3)  (5)  + (100/3)  (0.4)  1 - 0.  Notice  that  the  optimality  range  on  b' 
allows  b^  2.  2857  (u^  = 0)  . 

In  practice  cne  would  want  to  round  y in  such  a way  that  the  in- 
duced perturbation  to  b is  acceptable.  For  large  problems  this  would 
require  a systematic  approach  that  can  be  automated.  There  are  mamy 
ways  that  integer  problems  oould  be  formulated  to  derive  roundings.  The 
following  result  considers  one  possible  choice.  Let  L = (jlVj  fractional 
in  (SPq)  } and  suppose  'chat  6b  ^ 0 is  a limit  on  the  permissible  perturb- 
ation Ab.  Then  «m  acceptable  rounding  (of  the  fractional  components  of 
y)  is  given  by  the  following  0-1  integer  problem: 


’ Minimize  Z c ,y  . 

, y = 0,1  jcL  ^ ^ (11.9) 

subject  to:  Ay  b + 6b  - Alyl 

where  A denotes  A with  colunns  j,  j / L,  removed;  [y]  denotes  y with  all 
fractional  components  rounded  down  to  the  neeurest  integer.  The  next 
result  is  immediate  from  Theorem  11.1(b). 


Corollary  11.1.1:  Assvme  that  Y is  of  the  form  hypothesized  in  Theorem 

11.1(b).  If  y*  is  optimal  in  (11.9)  then  y E ly)+y*  is  optimal  in  (SP) 
for  all  right-sides  b'  satisfying  (11.4). 

Problem  (.1.9)  produces  a rounding  of  y that  makes  the  best  use  of 
the  availedDlf;  resource  reserves.  9y  the  corollary,  ly]+y*  is  em  optimal 
alternative  solution  to  (SP)  (at  the  perturbed  point  b)  . When  the 
nunber  of  fractional  variables  is  small  relative  to  the  total  number  n 
of  variables,  this  alternative  solution  is  obtained  very  cheaply  — cm 
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LP  version  of  the  MIP  plus  a small  0-1  integer  problem.  Since  the 
number  of  fractional  variables  cannot  exceed  the  number  m of  constraints 
one  is  assured  that  (11.9)  is  small  relative  to  (SP)  if  m is  small  rela- 
tive to  n. 

Computational  experience  indicates  that  the  number  of  fractional 
variables  arising  in  LP  resource  allocation  problems  is  generally  con- 
siderably less  than  the  number  of  constraints  m.  Even  when  n emd  m are 
of  comparable  size  one  can  expect  that  problem  (11.9)  will  be  a rela- 
tively small  problem  compared  to  (SP) . 

As  an  alternative  to  the  rounding  problem  (11.9)  one  could  select 
as  an  objective  the  minii  '.zation  of  e given  by  Theorem  10.2.  This  then 
would  produce  an  optimal  rounding  if  one  exists  and  applies  to  problems 
more  general  than  those  permitted  by  Theorem  11.1(b).  As  an  illustra- 
tion of  this  technique  and  applicat’on  of  the  preceding  theorems,  con- 
sider the  production  scheduling  problem  (with  I activities,  T periods, 
and  a single  resource)  discussed  by  Lasdon  [9] : 


Minimize  Z c . , 0 . . 

• • 11  11 

1.1 


subject  to:  Z a.  ,6.  . < b , (t  = 1,. 

13  1]  - t 

1.1 


E 0.  . = 1,  (i  = 1,. 


Y:  i 


0..>O,  (i=l,. 

11  - 


.T) 

.1) 


,1;  j — 1,... ,N^) 


(11.10) 


0 . , = integer  . 
\ 11 


This  problem  is  of  the  form  (SP)  and  since  Y involves  only  bounds  and 
CUB  constraints  on  0,  Co(Y)  = Y^.  Hence,  by  Theorem  11.1(a),  there 
exists  an  optimal  rounding  of  0,  optimal  in  the  LP  relaxation.  Notice 
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that  if  I >>  T then  most  of  the  components  of  6 are  naturally  integer 
(for  at  least  I-T  indices  i,  0^^  •=  1 for  some  i and  0 for  all  other  j). 
If  the  number  of  fractional  variables  is  small  then  any  rounding  that 
satisfies  the  GUB  constraints  should  not  appreciably  violate  the  re- 
source constraints. 

Let  0,u  be  optimal  primal  and  dual  variables  at  b in  the  LP  relax- 
ation of  (11.10).  Using  any  criteria  whatever,  round  0 (to  0)  in  such 
a way  that  the  GUB  constraints  (E0, . = 1)  are  satisfied.  Let  6 be  such 
that  0 satisfies  the  resource  constraints  at  6.  Then  0 is  c-optimal  at 
b where 


e H Z c.  . (0.  .-0.  .)  - Z U.  (b.  -b.  ) . 
■ 11  11  ID  , 1 ^ 

1,2  k=l 


(11.11) 


The  problem  of  finding  a rounding  6 that  is  optimal  at  some  point 

b in  (11.10)  can  be  expressed  as  a mixed  integer  problem  (which  is  much 

smaller  in  size  than  the  original).  Stated  in  words,  this  problem  is 

to  select  A0  and  Ab  to  minimize  c*A0  - yAb  (i.e.,  c,  given  by  (11.11)) 

where  0+AG  is  feasible  at  b+Ab  in  (11.10)  and  A0 . . = 0 if  0 . . = 0 or  1 . 

11  1] 

This  objective  qucintity  is  nonnegative  euid  when  equal  to  zero,  0+AO  is 
optimal  at  b+Ab. 

To  express  this  problem  mathematically  we  will  need  the  following 


index  sets: 


L {ilo.  , is  fractional  for  some  j} 
' 11 

L.  {jlo.  . is  fractional}  . 

1 ' 11 


The  O-.l  problem  is  to 
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Minimize  I E c..(y..-e.,)-  E uz 

i T ■ , ^ 1 t t 

y,z  ieL  ■'  •'  t-1 

subject  to:  E E . (y . . -0 . , ) - z^  ■ b - E . 0 . . 

. , , , 13  13  13  t t , . 13  13 

icL3eL.-'  ■'  i,3-’-’ 


(11.12) 


E y.  . = 1,  (i  c L) 


jtLi 


ID 


y^j  = 0 or  1,  (i  E L,  j e I.^)  . 


In  this  formulation  Ab  is  represented  by  the  z variable  and  A6  by 

y.  .-0.  . for  i c L cind  j c L.  (A6.  . = 0 for  all  other  i,  j)  . 

13  13  1 13 

Geometrically,  problem  (11.12)  accomplishes  f ind.' ng  a point  b on 
the  graph  of  v(b)  that  minimizes  the  difference  between  v(b)  and  the 
value  of  the  linear  function  v^(b)  p(b-b).  For  problem  (11.12)  this 

difference  is  zero.  In  general,  alternative  optimal  b exist. 

In  summary,  it  has  been  shown  that  for  general  bounded  linear  MIP 
problems  an  easily  calculated  qucintity  provides  an  upper  bound  on  the 
degree  of  suboptimality  of  a rounded  solution.  Problems  of  the  form 
(SP)  have  the  property  that  a rounding  of  y,  optimal  in  (SP^)  , exists 
which  is  optimal  in  (SP)  at  some  perturbed  RS  b'  ; when  Y involves  only 
bounds  and  integrality  constraints  on  y,  every  rounding  of  y,  optimal 
in  (SPq) , is  optimal  in  (SP)  at  some  RS  b'.  An  optimal  or  near-optimal 
(at  a perturbed  point  b')  rounding  of  the  LP  solution  can  be  realized 
by  solving  an  IP  problem  that  is  much  smaller  in  size  than  the  original. 

Probably  the  greatest  shortcoming  of  a rounding  approach  is  that 
tlierc  is  little  control  over  the  perturbation  Ab,  except  for  the  special 
problems  of  type  (SP)  which  permit  control  of  Ab  per  Corollary  11.1.1. 
The  only  control  over  Ab  is  via  the  selection  of  a particular  rounding. 

I f an  "optimal"  or  near-optimal  rounding  (at  b)  requires  a Ab  that  is 
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unacceptable,  then  a search  for  an  alternative  rounding  requiring  a 
mere  reasonable  perturbation  of  b amounts  to  a tradeoff  between  sub- 
optimality emd  the  magnitude  of  lb. 

On  the-  plus  side,  there  are  many  applications  in  which  rounding 
can  produce  desiredjle  results.  A particularly  significant  incentive 
for  using  rounding  is  the  relatively  very  low  computational  cost  for 
obtaining  information. 

11.3  Elastic  Resource  Models 

Use  of  relaxations  of  the  type  (G)  studied  in  Chapter  10  and  elas- 
tic resource  models  such  as  (10.10)  as  means  for  deriving  alternative 
solutions  to  (P)  has  already  been  emphasized. 

The  purpose  of  this  section  is  to  first  give  a brief  discussion  of 
the  properties  and  use  of  elastic  resource  (ER)  models  for  right-side 
analysis,  and  second,  to  present  additional  properties  that  result  when 
a parametric  penalty  is  used. 

The  special  case  of  relaxation  (G)  that  gives  zero  co  . . to  over- 
supplied resources  is  the  elastic  resource  problem: 


(Q) 


Minimize  f(c;x,y)  + p(z) 
x,y,z 

subject  to:  G(a;x,y)  - z ^ b 


(x,y)  e U 
z > 0 


whore  it  is  assumed  that  p(0)  =0.  An  optimal  solution  is  denoted  by 
(x,y;z).  Equality  resource  constraints  can  be  accommodated  by  express- 
ing them  as  inequalities. 

The  optimal  value  function  V(p)  is  continuous  with  respect  to  p. 
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i.e.,  the  data  defining  p,  as  well  as  with  respect  to  a,  b,  emd  c,  pro- 
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vided  that  p itself  is  continuous  with  respect  to  the  data  (this  does 
not  preclude  discontinuity  of  p with  respect  to  the  variables  z)  . These 
favoredale  continuity  properties  make  this  function  more  attractive  to 
analyze  than  the  generally  discontinuous  function  v(b).  The  fundamental 
relationships  between  V(p)  and  v(b)  are  furnished  by  Theorem  10.4. 

This  relaxation  of  (I  ) obtained  by  introducing  the  continuous  non- 
negative variables  z gives  recourse  to  the  resource  constraints  by 
allowing  them  to  be  violated  for  a price.  Of  all  nonnegative  perturba- 
tions to  b in  (P)  , z is  preferred  in  the  sense  that  it  affords  the 
greatest  net  improvement  in  optimal  value,  based  on  the  criterion  p(*). 

When  it  happens  that  z = 0,  then  additional  resources  are  more 
costly  than  they  are  worth.  In  this  case  the  optimal  solution  obtained 
for  (Q)  is  feas  .ble  and  optimal  at  b in  (P)  . This  situation  also  pro- 
vides a bound  on  the  sensitivity  of  v to  perturbations  in  b:  a per- 

turbation Ab  cannot  give  rise  to  an  improvement  larger  thsm  p(Ab)  (cf. 
Th.  10.4c);  that  is, 

v(b)  - v(b+Ab)  ^p(Ab)  for  all  Ab  e E*"  . (11.13) 

ihe  perturbation  z produced  by  (Q)  is  never  larger  than  is  neces- 
sary to  accommodate  the  obtained  solution  (x,y)  . This  is  expressed  as 
a complementary  slackness  property: 

Proposition  11.2:  Let  s denote  optimal  slack  in  (Q)  . Then  (x,y,s)  j.s 

optimal  at  b+z  in  (P)  ap"^  s*z  - 0 (provided  that  p(*)  is  monotone  in- 
creasing) . 

Proof : Extend  the  definition  of  p(*)  to  all  of  e""  thusly: 


! 


i 

I 

J 
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) ■ p(Z  «***iO#»**r  Z ) f if  Z j ^ 0 • 

1 1 m 1 in  1 

Then  p(z)  ^ p(i-a)  since 

V(p)  ■ p(z)  + v(b+z)  (by  Til.  10.4c] 

^ p(z-s)  + v(b+z-s)  [by  'rti.  10. 4d] 

- p(z-s)  + v(b+z)  [by  optimality  of  s]  . 

Now  if  z^  > 0 for  some  i (i  ■ l,...,m),  then  ■ 0 by  (strict)  roonoto- 
nicity  of  p for  nonnegative  arguments  — (if  s^  > 0,  then  z^  ^ 
max{0,  ^ mj'x{0,  so  ti;at  p(z)  > p(z-§)  , 

a contradiction) . | 

Typically,  z y 0 implies  that  b+z  is  a point  of  discontinuity  of 
v(*);  in  fact,  this  is  always  the  case  for  pure  integer  problems' 

Proposition  11.3;  Suppose  that  (P)  is  a pure  integer  problem.  If 
z y 0 where  z is  optimal  in  (Q)  for  emy  p,  then  v(*)  is  discontinuous 
at  b = b+z. 


Proof;  The  result  follows  from  the  characterization  of  v(*)  as  a finite 


set  of  constants:  define  R = {b  e E"'|v(b)  < ® } and  e {b  e R|v(b)  = 

V (b)},  y Y.  That  is,  \1  is  the  subset  of  R on  which  y is  optimal  and 

y y 

v(b)  = f(c;y)  for  all  b c W . Since  R = U W and  Y is  a finite  set, 

^ yeY  y 

it  follows  that  R is  covered  by  a finite  number  of  sets-^  on  each  of 
which  v(')  is  constant. 

Suppose  now  that  v(*)  is  continuous  at  b+z.  Then  3 a b'  < b+z  t 
v(b')  = v(b+z)  , where  equality  holds  per  the  above  characterization. 


* / 

Incidentally ,_it  is  straightforward  to  show  that  the  "optimality" 
parameter  sets  W are  polyhedral  if  a'' I constraints  are  linear. 
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But.  then  complementary  slackness  is  violated  since  s ^ bts-b*  > 0 and 

££0.  II 

Problem  (Q)  does  not  place  explicit  bounds  on  the  perturbation  z 
to  b;  however,  such  bounds  may  be  enforced  effectively  via  high  penal- 
ties for  large  values  of  z.  For  instance,  requiring  that  z c S = 

{z  c E™|o  £ z £ u}  is  equivalent  to  defining  p(z)  “ “>  for  z ^ S.  Since 
Theorem  10.4  applies  to  discontinuous  functions  p(*)  , it  remains  valid 
when  the  bounds  z e S are  added  to  problem  (Q)  . This  alleviates  the 
need  to  define  p(*)  outside  of  the  set  S and  avoids  having  to  dea..  with 
too  complex  a function  p(*)- 

Because  the  main  goal  is  to  derive  alternative  improving  points  and 
solutions,  t!'.e  accuracy  with  which  p(*)  represents  the  decision-maker's 
real  costs  is  not  critical  — the  penalty  function  is  primarily  a device 
for  discovering  'reasonable"  perturbations  in  b that  give  rise  to  dis- 
crete or  relatively  large  improvements  in  optimal  value.  A linear 
parametric  representation  of  p{*)  will  be  sufficient  for  many  applica- 
tions . 

Let  0 be  a scalar  parameter.  A parametric  penalty  linear  in  6 is 
given  by  0q(z)+r(z).  When  this  penalty  is  substituted  for  p(z)  in  (Q) 


the  optimal  value  can  be  viewed  as  a function  of  the  single  v-.riable  0. 
If  r(*)  is  chosen  as  a lower  bound  on  the  decision-mcdcer ' s true  penalty 
and  r{*)+q(*)  as  an  upper  bound,  then  the  pertinent  values  of  0 lie  in 
the  unit  interval  [0,lj.  Since  0 appears  only  in  the  objective  function 
the  theory  and  analysis  methods  of  Chapter  9 apply. 

Use  of  the  elastic  resource  model  [Q)  with  a parametric  penalty  in 
effect  converts  the  problem  of  right-side  analysis  to  a problem  para- 
metric in  the  objective  function.  Deriving  V(0)  for  values  of  0 between 
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0 and  1 produces  a set  of  alternative  solutions  to  (P)  . The  function 
V(0)  is  concave  and  monotone  nondecreasing  with  respect  to  0;  this  holds 
for  arbitrary  functions  f,  G,  q and  r.  If  the  parametric  penalty  is 
tciken  as  0q(z)  , then  these  properties  imply  that  for  any  optimal  solu- 
tion function  (x(6) ,y(0) ;z(0) ) , fne  improved  optimal  value  v(b+z(0))  * 
f(x(0),y(O))  is  monotone  nondecreasing  and  the  quantity  q(z(0)),  the 
slope  of  V(*)  at  0,  is  non increasing. 

.Mtemative  solutions  to  the  following  capital  budgeting  problem 
were  generated  by  deriving  V(0)  using  the  procedure  described  in  Appen- 
dix 9A. 


v(b)  = Mzoc  r,  c.y.  Ay  < b 
11  — 

y=0,l  i=l 


(11.14) 


where 


c i (35,  85,  135,  27,  94,  10,  140,  25)  , 


’l  4 

17 

2 

3 

4 

13 

3‘ 

.2  6 

14 

9 

i3 

3 

24 

6 

' “ l38 

Penalties  qz  ; (5,5)  ^2  | ' = 0 were  selected,  giving  the  elastic 

resource  problem: 


V(9)  = Ka'cimum  c.y.  - 0(5,5) 

y=0,l  i=l  ^ ^ '^2/ 

z>0  (11.15) 

- 

subject  to:  Ay-  < b . 

V2I  - 

It  was  found  that  z = 0 for  0 = 2 (hence,  for  all  0^2,  z = 0 and  no 
net  improvements  to  v(b)  are  possible);  at  0 = 1 , z = (0,3),  affording 
an  improvement  of  cibout  7%  in  the  optimal  value  of  (11.14);  etc.  Re- 
sults are  graphed  in  Figure  11.2  which  shows  V(0),  z(0),  and  v(b+z(0)). 
(Since  (11.14)  is  a maximization  problem  the  usual  senses  of  monotoni- 
city are  reversed.) 
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19,39) 


11.2.  The  Functions  V(0)  and  v(b+z(0))  for  Example  (11.14) 


Several  penalties  were  selected  to  determine  the  effect  on  the  set 
of  alternative  solutions.  These  included  q ■*  (6,4),  (4,6),  (7,3),  emd 
(3,7)  , all  with  r ■ 0.  In  each  of  these  cases,  deriving  V(0)  over 
9^0  produced  the  same  set  of  perturbations  z and  hence  the  same  alter- 
native solutions. 

In  linear  problems  such  as  example  (11.15)  the  function  V(6)  is 
piecewise  linear;  corresponding  to  each  piece  is  an  alternative  solution 
(x,y,z)  to  (P)  with  optimal  value  v(b+z).  Tliat  is,  z(6)  and  v(b+z(9)) 
are  piecewise  constant. 

The  set  S of  solutions  z generated  by  deriving  V(9)  is  efficient  in 
the  sense  that  if  z £ S,  then  v(b+z)  < v(b+z)  and  p(z)  £ p(z)  imply  that 
z ^ S. 

To  coirpare  alternative  solutions  to  (P)  the  decision-maker  essen- 
tially must  perform  for  each  alternative  a tradeoff  between  the  amount 
of  improvement  Av  provided  in  v and  the  increase  z in  b required  to 
produce  that  improvement.  Whether  or  not  a set  S of  alternative  solu- 
tions includes  the  "most  preferred"  alternative  depends  on  the  decision- 
maker's tradeoff  function.  If  this  unknown  function  were  linear  in 
f(x,y)  cind  p(z),  then,  of  course,  using  a parametric  penalty  0p(z)  in 
the  elastic  resource  model  (0)  and  deriving  V(6)  over  a reasonable  range 
of  values  9 will  assuredly  produce  the  decision-maker's  most  preferred 
alternative . 

11.4  Stimmary  and  Conclusions 

Relatively  inexpensive  bounding  tests  can  be  made  to  determine  if 
substantial  improvements  in  v(b)  are  possible  (or  impossible)  by  allow- 
ing a perturbation  to  the  right- ;ide  b.  If  these  tests  imply  that 
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improved  solutions  are  possible,  th>»n  any  one  of  several  methods  can 
be  used  to  discover  alternative  solutions.  Two  particularly  attrac- 
tive approaches  are  rounding  and  use  of  elastic  resource  formulations. 

Optim^dity  of  a rounded  solution  at  a perturbed  right-side  is 
guaranteed  in  certain  classes  of  MIP  problems  (Th.  11.1).  In  the 
general  case,  the  degree  of  suboptimality  in  the  MIP  if  a rounded  solu- 
tion is  easily  computed  (cf.  Th.  10.4).  "Optimal"  rcundod  solutions 
can  be  derived  via  relatively  small  0-1  integer  programs. 

An  elastic  resource  approach  gives  recourse  to  the  resource  con- 
straints by  allowing  them  to  be  violated  for  a price.  In  terms  of  a 
given  cost  criterion  p(Ab)  , this  approach  provides  a solution  to  the 
ilP  problem  that  gives  the  maximtin  net  in^rovement  in  optimal  value.  A 
collection  of  alternative  solutions  can  be  generated  by  varying  the 
penalty  cost  linearly  in  terms  of  a scalar  parameter  0.  This  parametri- 
zation  effectively  converts  the  right-side  analyses  problem  to  a problem 
parame' • ic  in  the  objective  function,  for  which  straightforward  para- 
metric procedures  exist. 

The  attractiveness  of  a rounding  approach  is  that  alternative  solu- 
tions to  the  MIP  problem  are  provided  very  cheaply  by  solving  a continu- 
ous-variable relaxation  (and  possibly  a small  0-1  integer  problem)  ; the  3 

elastic  resource  approach  involves  solving  another  MIP  problem.  On  the 

other  hand,  a rounding  approach  cannot  involve  the  decision-majtor ' s | 

"costs"  assigned  to  a perturbation  Ab  and  it  is  possible  that  although  ' 

j 

rounding  produces  a i.olutior  to  the  MIP  vnich  grants  an  improvement  in 
optimal  value,  this  improvement  may  be  overshadowed  by  the  decision- 
maker's costs  assigned  to  the  required  perturbation  Ab.  The  elastic 
resource  approach  permits  one  to  consider  explicitly  in  the  model  an 
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estimate  of  the  decision-maker's  costs. 


An  elastic  resource  model  specializes  easily  to  the  case  where 
only  right-side  changes  in  a direction  b'  are  of  incerest.  Then  z is 
a scalar  variable  and  the  perturbation  to  b is  given  by  Ab  = zb*. 
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PART  III 


CHAPTER 

CONCLUDING  REMARKS  AND  TOPICS  OF  FURTHER  STUDY 

Sensitivity  ^u^alysis  in  mixed  integer  programming  is  a new  and 
much  needed  area  of  study  that  will  undoubtt Jly  assume  greater  signi- 
ficance as  MIP  solution  methods  advance.  It  is  acknowledged  that  this 
treatise  on  the  subject  is  a mere  beginning.  It  is  lioped  that  our  com- 
prehensive theory  of  continuity  provides  greater  understanding  of  the 
causes  and  ways  of  dealing  with  the  discontinuous  behavior  that  is 
typical  of  MIP  problems.  We  consider  the  treatment  of  sensitivity 
theory  and  analysis  to  be  both  very  general  and  practical  ; to  be 
fully  exploited,  various  specializations  and  computational  experience 
with  special  classes  of  problems  will  be  required  as  a next  step. 

In  developing  and  specializing  analysis  techniques  to  problem 
classes  it  is  importcint  to  consider  the  type  of  code  required  for  im- 
plementation. A requirement  for  a very  general  MIP  code  to  analyze  a 
special  type  of  problem,  that  is  usually  solved  with  a special  code, 
can  be  a deterrent  to  conducting  analysis.  In  facility  location 
problems,  for  instcuice,  it  is  easy  to  show  that  the  elastic  resource 
approach  can  be  implemented  by  simply  adding  a dummy  facility  and  a 
dummy  demand  zone  to  the  problem,  still  permitting  the  usual  trans- 
portation type  subproblem. 

rJumerous  computational  studies  are  called  for.  These  include 
studies  to:  (a)  evaluate  and  compare  merits  of  the  various  analysis 

methods  in  terms  of  tlie  information  produced,  (b)  determine  computa- 
tional efficiencies  and  requirements,  and  (c)  gain  a better 
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understanding  of  the  behavior  of  special  clauses  of  problems.  It  is 
intuitive  that  em  elastic  resource  relaxation  (e.g.,  (Q)  , 511.3)  should 
be  algorithmically  easier  to  solve  because  the  z variables  make  it 
easier  for  a feasible  solution  generator  to  achieve  feasible  rounded 
solutions.  Of  course,  computational  experience  is  needed  to  bear  this 
out.  It  is  also  intuitive  that  rounding  will  produce  attractive  alter- 
native solutions  for  problems  with  a large  number  of  variables,  espec- 
ially when  the  number  of  fractional  variables  is  relatively  small. 

There  are  other  important  areas  of  further  research.  One  of  these, 
perhaps  the  most  important,  is  the  design  of  computer  runs.  Run  design 
involves  the  definition  and  sequencing  of  problems  to  be  solved  that 
will  yield  the  desired  information  at  the  least  computational  expense. 

The  basis  for  run  design  is  a priori  knowledge  of  how  the  optimal 
solution  (x*,y*)  behaves  with  respect  to  the  data.  This  type  of  knowl- 
edge can  suggest  not  only  cin  efficient  sequencing  of  runs  but  how  the 
most  information  per  run  can  be  obtained.  As  an  example,  consider  the 
capacitated  facility  location  problem  (cf.  54.2,.  If  a run  is  repeated 
with  all  capacities  and  demamds  scaled  by  a factor  6,  the  result  can  be 
used  to  predict  by  inspection  the  consequences  of  repeating  the  original 
run  with  the  fixed  costs  (y  coefficients)  scaled  by  a factor  of  1/0, 
and  conversely.  There  are  also  otlier  reciprocal  relationships. 

Another  interesting  area  for  future  research  concerns  the  decision- 
maker's unknov,n  preferences  for  alternative  solutions.  Since  a collec- 
tion of  alternative  solutions  to  an  MIP  problem  is  generated  for  the 
purpose  of  providing  the  decision-maker  with  a choice  that  best  satis- 
fies his  preferences,  one  naturally  must  be  concerned  with  the  possi- 
bility that  this  set  excludes  the  most  preferred  alternative.  If  the 
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decision-meJcer ' s preterence  is  represented  by  some  (unknown)  function 


).  p{Ab)]  where  v is  the  improved  optimal  value  and  Ab  the  associated 
perturbation  to  the  RS  b,  then  the  preferred  alternative  is  given  by 

Minimize  h(f  (x,y),  p(z)  ) 
x,y  ,z 

subject  to:  G(x,y)  - z ^ b 

(x,y)  e U . 

Problems  of  this  type  with  convex  domains  are  studied  by  Geoffrion, 
Dyer  and  Feinberg  [1]  and  otliers;  these  developments,  however,  do  not 
apply  to  problems  with  integer  restrictions.  Conditions  on  h,  f,  p, 
etc. , and  approaches  to  generating  alternative  solutions  are  desired 
which  assure  that  a set  of  alternatives  includes  a solution  to  (H)  . 
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